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ABSTRACT \ • > ( . , \ 

^-This report describes the Educational Voucher 
Demonstration, selves as a guide for its documentation , and offers an ' 
extensive bibliography. Part 1 <,gives background information and 
summarizes the implementation of the Alum Jtock Demonstration based on 
a transitional voucher moflel .and involving six public schools, each 
offering at least two distinct "min isfchool" programs . The Rand 
Corporation 's "evaluation plan defining the project ts hypotheses end 
assessing political, social, economic,, and educational outcomes 
within a framework: of 12 information/ categories and 40 outcome 
dimensions is discussed. Thetypes of datfe collected for each outcome 
dimension and the data analysis* techniques used are* summarized in 
tables. The incremental implementai on of the demonstration is , 
analyzed year by year . In addition to describing, archive files, part 
2 summarizes* substudies including: . (1) the creation of a demographic 
database; (2) parent and community surveys addressing parental 
information levels, schooling decisions, and attitudes; (3) surveys 
of teacher attitudes toward parental choice and the demonstration; 
(4) the Metropolitan Achievement Test; and X 5J the Children's - . t ' 
Self -Social Construct Test. Also provided is a programmer ' s^guide 
offering description^ of linkage/ variables to assist in jnerging # • 
existing archive files to produce new analysis files. (MJ-L) ; 
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I. OVERALL PROJECT DE SCRIPTION • > s + ' 

♦ •• 

A. INTRODUCTION ' . * " \ 

•The Educational Voucher Demonstration was a large-scale educational 
and social intervention conducted over/ a five-year pferiod (1972-1977) ;Ln 
V -Al*n» Rock Union Elementary School Distr.it t^Sah Jose, California. In 

. ' ■ \ . » ■ • " ' \ 

April 1972s the Office of Economic Opportunity (0E0) awarded Rand Corporation 
a contract to act as independent evaluator of the Demonstration. After 0E0 
wps disbanded during the Nixon administration , the Nat ional Ins titute * of * ' 
Education .(NIE) assumed responsibility for the Demonstration and subsequently 
renewed Rand's contract. . 

1. ' Definition and Theory of Vauchers v 



"Voucher"- is a convenient label for a certificate issued by the«government \ 
to parents who. , in turn, give it to an eligible school 'which returns -Lt to ' » 
the government for cash. . According to voucher theory x parents could' use their 1 
voufhers to translate their concern .£ or their children 1 s education into Jaction. 

If the parents (or the chil'd) did riot like the education the child. \>as^r$cVivine, 

• . ' " . :<' ' i: ':• : •• " { V • ; . * 

the child could use the voucher to *o to another school. ' encouraRiiie both f 

" * "•.••*: ' . • • v/" 

active parental interest and educational Variety, a voucher system should" 
improve 'all participating- schools—public, parochial, and private. /P<arentd 

% - would be able to band together to finance and form schools which reflected 
their special perspectives ox their children's special* needs.' Even if no 

' ijew schools ^ vere established, existing schools would become^ more- respon- 
sive to children v s* needs 4 ./ Expanded and diversified sources of input re- ^ 
-garding school program decisions would help tt> overcome the public schoolfS 
^nphasis on uniformity. For instance, .educators whose philosophies differed 
from those prevailing in existing schools would have the opportunity 



t 



v 



I to implement dheir ideas in new schools. Even entrepreneurs who felt they * 
could teach children better and more cheaply would have an opportunity to 
do so under this system. \ •;■ v ., . 

Despite these attractive theoretical features, sowe educa tofs and — 
Social "scientists have had grave reservations about vouchers^ Testifying ; 
v before Congress in 1971, the National Education Association said tha scheme 
was so pernicious that any" use of government funds to test its strength 
and weaknesses was inadvisable. One charge.-leveled : against voucher - - 

■ ■ ■ ' ■' . • '•*••'."•• 

■ ■....!»*«• ■ .- .... 

proposals was that rampant hucksterism could invade education. Confronted " 

■ - „ ' - " ■ ' . : ' >. ■ ■ ■'. 
with sales pitches and advertisements, the public would be unable to 

, disti nguish t.rue claims from false and inadvertently fund inferior schooling. 1 
The cost po their -children would be great; only the educational entrepreneurs l 
Would benefit. * , • ' , 

■ . • * ' ■ "o r • /V";:--. . ••' 

• ^ Another importan^oh^ection was t}iat vouchers would destroy the ' - 
> ' ' ... . ' .'. ' ■ .- r \ : . 

democratic values that public schools share and instill . Sacrificing j 

uniformity in favor of diversity could undermine a vital role of American 
public education. • ' . " ... .' 

Many critics charged that vouchers would encourage segregation by 
SQcial class, race, and ecoilonric status.* By supplementing their vouchers 
wxth additional payments; wealthier families could band together as 
clientele for "expensive schools. • * 

The inclusion 'of parochial and'private schools' also raised objections,' 
Allowing parochial/schools to participate in vouched systems was viewed 
as an infringement on the constitutional separation of church and 'state. . 

Public educators f. eared that including prlvajjg schools- would draw the 

■ ■ '" - * " " : »"' ■ ' o 
^bright and the affluent away, from public schools, leavirig only those students , 

• who were poor or less able\o'r had difficult learning problems. " • * 

'■■ '■ • : '. . '** .='••• ' '■. ' •*.'•''.'' '■ • - 



J 



i Faculty, and administrators saw vouchers as a threat to job Security* * 
and tenure, despite the theoretical safeguards- against this possibility. l% 

• Finally, some believed 'that vouchers would increase the cost of. 

• • ■ ' r • • 

k . • . ' • 

public elementary and secondary education. • 

'■ • • . * ' ; ' "■ ■ ■ : \ - , : • " , ; •• 

It must be -stressed that there is no single voucher theory and that, ^ 

. ' . ••. . . . . ■ ^ • 

t as legitimate as tliese objections might; have* been , some voucher plans offer 
.' • * •■.;•'..# . • ' v , 

* more assurances to the relevant publics than others. The next section 

• ■ . - ' y ' ■(:•' ' ■ >■ 

.bridfly describes 'a number of alternative voucher models in an effort to 

„. demonstrate** the variety among them. # • 
2. Voucher Models 

., » ; . » » 

In the late 1960s, 0E0 investigated vouchers as a way .to improve* 
.the educational opportunities of .poor families and retained the Center 
/for the Study of Pub,lic Policy (CSPP) to study u t£e- voucher concept . the 
yodels summarized in this section were described^ CSPP 1 s final report. • 
(December 1970). , - 

Social thedrifet Adam Smith first proposed (1837) that thB government . 
'finance* education by giving parents monej^tb hire teachers. Since then,* 
other, theorists and economists have proposed a variety of voucher plans. 
All. share the guatante^e that voucher schools will be able to offer 
programs at costs comparable\^tlj^e of public schools. The major - 
differences between these plans i,s the way. they regulate schools 1 efforts. 
Some schemes advocate no fiscal* regulations, while others involve considerable 
regulation to offset differences iri t parents f f incomes. Still other plans 
entail administrative regulations aimed at ensuring that schools do not 
discriminate against ^disadvantaged children. Finally, some schemes 4 establish 
regulations to provide the public with information about what each school 
* attempted to teach and how well each succeeded. - 
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a. Unregulated 1 Market Model;; . • * ^ < ■ 

Under the unregulated market model , advocated bv Friedman (1962). and * 

oth&r?,* every 'child would receive a f lat gratit *which parents could 'use to 

• \ , : , • : ■" * ■ 

pay tuition at the school of their choice. This schene permits schools 

to charge whatever additional -tuition the traf fiic will bear . The unregulated 

: . ."■ • • ■ . • s \ "■ \ ■ 

market mod 61 ."has been criticized by some as favoring ^he -rich', increasing 
economic segregation , ^ and intensifying . the present problems of^chools . 

b. Unregulated Compensatory Model . ' . f 



I 



/ y "* - '. ■■■ v ' .'■ • ••■ _ • ■ ' .... v 

As a\responste,to these criticisms of the unregulated' market model, Sizer • 

' . • '? . •. ': ' ■ '. •• • \ r -■ } • •■■ ] 

.and Philips (1965)- proposed an' unregulated compensatory model which would | 

■•*- . .... -, ■ • . . '* / " . • • ...J- 

• v increase voucher values for children from families with incomes below "the "" \ 

" ■ •■• • ' « ".. ' • ^ , ' v", .' • ; 

. . national^ average . Schools would still be permitted to charge whatever they '< 
. wished. Many felt this plan would probably result in a completely unregulated 
situation because highly motivated, low-income families might opt to spend 
more of . their own money tjo send their .qhildr en to a better school. If legis- 
t • lation were designed to insure that every- family would- get a fixed amount, of 

dollars per child, then schools would most "probably set their tuition at or \ y 
near -tjiat amount. ' / - * . "* V ..... 

v.--' . ; • • . . . / > ■ . \ . ■ 

. • ^ . - - ■ . . \j ... 4- ■ > 

c. Compulsory Scholarship Model . ( . . \ 



The compulsory scholarship' model resembes the unregulated market and tin- 



regulated compensatory models in that schools would be free to charge whatever 
tuition they desired However / participating schools would be requJ.red^to 
provide enough scholarships so that no family paid more than it could affdrd. 
^Scholarship eligibility and size -would depend on a formula determined by an 
Educational Voucher Agency (EVA) 7 This plan 1 s drawback is that since tuition 



is the same for all students attending- a- particular schobt,^the only way that : 

•schools can generate^ more money is v to admit wealthier stbdents. In effect, the 
compulsory scholarship moddl* would become virtually identical to the unregulated 
market -mq£el. '. . . . s ■ '• Q w ; ; -- =: .--V 
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,oons and, his associates (1970) offer a solution* to the problems 
Posed by the compulsory scholarship model: the effort model . This model ; 
allows every school to choose one of four different expenditure levels, 
ranging from roughly , the existing' public school expenditure level to two to 
three times that amou-ntT"' Parents choosing high-expenditure schools would 
..pay more,. tuition (or tax) than' parents choosing low-expenditure schools. * 
... However, .the amount of money each, family pays^would. depend not only on 
the cost of the school chosen, but also on the family's ability to pay. ' 
The government would contribute the d if ference between . what a family could 
-,pay and what the school spent -per 'pupil." : < Although the effort voucher 
model would lead to a" substantial increase inJparental choice, it would 

. also lead to a much .greater < spread betwfeen the "best" and the "worst" > 

• '.'■*.'** ' « ■ *. . 

schools than exists within. most public school systems today, - 

Egalitarian Mod*el ."•* - 

Another model, the egalitarian, would provide all children Wth • • 
vouchers of equal value and prohibit any school .accepting vouchers from * ' ■ 
charging tuition above the voucher's value. This plan assumes that. a voucher's 
value wSuld.be^ comparable to the present and projected per pupil expenditure, 
of- public schools. Additional funding might be obtained from federal or 
state government; or, iy&- C ase of private schools, from the church, Llumni. 



or parents.. Wh^, an "increase, .in the voucher «s valuers felt necessary, . 
■ . schools could work together to persuada legislators to provide more funding. ' " 
./ ; A variety of observations* have . been made about the egalitarian approach:. ^ / 

; it would produce less -segregation by race, . income, and ability thin any ''■ ' : 
^ . of the unregulated models; ;Lt would create a more equitable allocation" of . \ . 
•U _^ational resources between the rich and thV poor than the unregulated ''';:/■ 
■ - models; how^ less than the unregulated models for parents- '^Pi 

dissatisfied^ system. Nevertheless . this 



■ .'• : :' • v j .' "\ v - » : •;■ '• ■*■ >v. : 

^ model would provide more satisfaction than ttie. present system to parents seeking * 6 

f * • 

. to improve the way schools, are run. . * % , • % . - v 

f. Aphie\&ement Model ' . ^ 

Another proposed approach differs from the foregoing models in that the ' 



value of the voucher is determined according to'whether the school actually 

sudceeds in teaching the .child what the state ox the parent Wants the child to ■ 

^ *» ■ * 

. * ' y ... ' 

learn^ The basic assumption underlying this achievement modej is that the 

effects of schooling can be measured using standardized instruments. On Jth6 \ 

»■ .. • 

.basis of test results , schools which produce good effects would be rewarded 

/ • • 7 . ' ~ ' . v ■■ - : 

/ whxle those- which produce poor effects would bfe penalized. This model has been 
.criticized because it implies that standardized .tests are valid and reliable 
measures of educational performance. **Far more research on^the value of .test- 



s cor es^as measures of school output is needed befpre initiating a program' which 

- m - . * :; *\ V - *A 

u might encourage schools to emphasize such scores at the' expense of other outputs 

• . .* ' ■ 

of schooling.* , • ^ : * 

g. Regulated Compensatory^Model 

. . " * .*'.■'■ . . . • . .* * * 

\ - A f ina£ model, the regulated compensatory model , was advocated by Jenfcks 

• ' . <% ■ ' . . ' ■ . • 

; (1970) and others. It resemble.- the egalitarian apprpach in that" every child 

would receive ^ voucher roughly equal to the cost of public schooling in;. his/her' 

: distinct. Nb voucher school would .be allowed to charge* tuition exceeding the, 

voucher s value. Schools could -obtain additional" special purpose money by. 
•.•V,;;" 9 , ■-■ v ~ . * : x 

^ • • seeking endowments from churches , federal agencies, and- foundations. Enrolling 

disadvantaged children would generate, increased: income , s % ±nce the EVA would 
' absorb the extra" costs. , * : 

: r :: ■ * • V. ,r - . .... . . • -'\ . • *' ; : 

: *h. Summary of Models : 

■ ®* the models proposed, only the regulated compensatory model seems likely 
^ to increase educational opportunities for* the poor, parochial schools- > : 

might not find this model is' attractive as the egalitarian model, sin^e these 

q ^ools substan 
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Thfcee other models have been proposed: the California -model , in . v. 

• - \ . V * I • 

* which; puJ>litf v schc>ols whose students 1 average reading scores are below 

the national average are eligible to receive ^vouchers; the escalation - 
codel, which guarantees a fixed ratio between the overall level of tax % 

' • ) , : < ' : ; 

support and the overall .level -of private expenditures for tuition; and -£he 

• > * .V... • ' \: ' ■ ' ' ' - — , 0 • / . r 

• ••■ >\ . • . * . . . - - ■ \ L 

- incentives for integration approach where the voucher's value partially 

depends on * some optimal .racial, economic, or achievement mix. 

"' v. '". o : V*-\ : :; • • . " ' \ ■ ' 

. 3. Events Prior to the Demonstration 

' ; . ■ : . a . : - • . • 

: In March 1970, ^CSPE- proposed, ' and 0E0 agreed, that a Voucher Demon- 

i •«,'"■" * :> * • * •■ * ■ 

stration be initiated and tha.t the regulated compensatory model be used 
in this Demonstration.^ This* model included, and the Demonstration was -to 
include * \ ; \ 

a ^public and privat*e schools. ; ./ y - v 
\ is basic vouchers* equal in Value to current per pupil spending * 
in the public schools of. .the Demonstration .districts. 

• compensatory vouchers of extra. value for pdor children so 

that these children and their paren °- would have more, purchasing 
power in the educational marketplace. , 

• . school "tuition" limite^ to tSne local value of the basic . ' 

voucher. " ' 

• • a, lottery admission- system for schools receiving applications' 
" in-exclMs^of ^opianings. * .... . , , '* 

' free transportation, for children enrolled at schools distant 

;V : •'••Vv. : ' •I s ': ':' ' '-u; 
\ ; from their homes'. . . \ % ■ ■■'■"^"'^ ^ 

' school revenues entirely dependent on enrollment . 




o rights of students tc transfer from one school to another • » 

• ■:. v: : X- : '. ■ ■■. '-''■-..•v. - : ' ■ 

at v aiiy l.t^e/'and'-.to take with them proratfed portions of their 

; ;vo^her dollars . \ * 
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• an autonomous public i^gency, the Education Voucher Agency 

(EVA), to manage the Demonstration, including its fiscal 

r ^ . . . '<j 

, arrangements and start-up' activities, and to provide information - 
'• to, parents. ' (The local board of education might or might 

not .:»rve as ~he EVA). • * . . . \. 

• no guarantee of survival for any public or private school, newly > 

. ... ^created or previously operating, unless voucher income covered ' 

"..*■■■ # * •'.••'.•*'. ' 

expenses. ; ' ; . ' . .•" 

■ v In 1971, on the oasis of the CSPP report, 0E0 funded voucher feasibility 
\ studies in.. four school districts: Seattle, Washington; Gary, Indiana; 
SaA- Francisco, California; and Alum Rock, (San Jose) , California. The. 
first" three districts decided not to participate for a variety, of reasons : * 

» ' . « 

fears that parental choice could lead to racial segregation; reluctance 
to serve as guinea pigs for an untested model; general decline of support 
for 0E0* initiatives by organized leaders of poor people; opposition by 
[ teacher organizations; and absence of state legislation^ permitting private 
school participation.. Only the r fourth district ^Alum. Rock, was willir./ 
toastry the voucher concept, 

. - , \- * 

The Alum Rock Union^Elementary School District is in the eastern 
section of S^Jo^eT^California and serves children in kindergarten 
^?ough efghth gradev At the beginning of the Demonstration, approximately 
half of^the 15,000 school children in ( Alum Rock were Mexican-American, -40 < 
percent we*e\ Anglo; a,nd 10 percent were black. Most were from lower-tniddlel 
class W lower-class families. The population was highly transient and-no- 
; pattern of : ethnic 03 racial housing segregation existed. ' Surprising there" 
was little effective political mobilization or focus for organized social 
Change in the district, • V o - ~ " : 

, ■[ • . . • ' - " * ♦ • 
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The annual district budget exceeds $17 million; however, the 
district hasonfe.of the lowest assessed property valuations -Tper student 
, in California*. Despite high tax rates, income from. local revenue 

sources continues j:6 be low; "This factor no doubt contributed to local 
interest in the 0E0 initiative for a Voucher Demonstration. 

Teacher organizations had succeeded' in* obtaining teacher salaries . 
comparable with those in mcwre affluent districts. Their relations 
. <$with the district supierihtendent were cordial and cooperative. Appointed 
r in;196§, the superintendent had workfed to decentralize "decisionmaking 
to the school levels to increase parent participation in schools, and 
to recruit minority staf f^actively . 

*' /' . •. t ' ' *: w *\ . ■' ..... 

Alum Rock s superintendent saw.thfe Voucher Demonstration as, a means 

■.'*'* ..." ■ ' . ■ ' ' * " ■ - . • 

of bringing federal dollars into the financially-strapped district and V- 

,\ ■ / ' . - "' V - . .■ 

also as a means of furthering the policies of decentralization and parent 

participation he had been attemptirig^ since 1968. 

The Center for Planning and Evaluation (CPE) c^d^icted^the Alum 

Rock feasibility study. CPE^ the research arm of the Santa Clara^County 

Board; of Education, held public forums which drew large audiences,, but " 

comments-* about the Demonstration were overwhelmingly negative . A CSPP 

field agent who attempted to obtain minority group support -also 

encountered resistance and indifference. State legislation to permit 

state funds for private schools was pending and it was "feared that the 

EVA would recommend not . to authorize vouchers. However., CPE surveys 

of parents and. teachers yielded more promising results which the super- 

intendent and other voucher proponents" used to bargain for more time.' 

The strategy proved successful: a moratorium on further discussion of ' 



vouchers was passed . 



is 
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By winter jof 1972-, the California legislature still ha : d not enacted 
.legislation permitting private school participation in a Voucher 
Demons tration.qndOEO. was under considerable pressure to produce siich 
a Demonstration or forf eit additional planning mbnies. , The. solution "to these 
two problems was the transition voucher model. In January 1*97 2& the 0E0 1 

$ • ' • * 'r* 

experimental director and the Alum Rock superintendent met and developed 

;■' .•" * •/ \ ' ' r ' v ' : . 

the concept of a "public schools only" .Voucher -Demonstration. Und^er 
this concept; parents would choose among' public schools only, and, there- 
fore, no .legislative -action would be required. The program was termed a 
"transition" model, ^since it was an intermediate step between current 
^public school practices and a full voucher model -involving both public . * ' 

and orivate schools. . • ■'• . 

i * *■ « * -. 

/ ' ■ .' . ■ ■ ...... . *\ '•" 

The transition model had the following features. 



• . Initially, it would involve only public schools, with-~six — 

v • " . > . : . . . •• ' v * ' • 

of the district's 24 schools participating. V * 

• Participating schools would • offer two or more distinct. 
' progratas or "minischools." 

The district would provide the basic voucher from its current 

income and OEO would provide a compensatdry .voucher for 

• ' . •■ / ■ : ' • - - ' ' ; ' . . 
qualified children. 

• " J •% " . ■ v ;V . ■ ■ S~. 

9 Teachers job tenure and seniority rights were guaranteed. 
The Altan Rock Board of Trustees and the superintendent 
were -to ^manage the Demonstration..- An Education Voucher ~~ 

\ '. ■ . \ . • . . ■ •• 

Advisory,' Committee (EVAC) , " composed of voucher school A staf f 
and parents, was established. • ^ 

• The'district contracted with the Sequoia Institute to 
.establish a central vouched ^s faff responsible for ^assisting 

»• in start-up, in^rnal evaluation, and parent counseling. 

^:<- V^ ■ < ' :■: . I':- 

innnmnnll fe ^^OlEXIN 
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.4 . Implementation Prior to the Beginning of the Demonstration. .^ 

In the. 1972-73 school year, six. Alum Rock schop^.4 participated in 
the Voucher Demons txat ion ._..Participat ion was initiated by the principals : 
of each of the six schools, but was sub ^ectT^to 7 approval by a majority 



jof ^teachers. .Five of these u voucher ,t schools were elementary and pne 
was a -middle, school; each -shared the general socioe^gnpmic characteristics 
of the district as a whole. ■ * - - 

During the formative stages of'thfe Voucher Demonstration, Alum 
Rock parents were more concerned with preserving the neighborhood school 
concept^than^with increasing choice. These concerns -were not unfounded. 
.As a safeguard against discrimination, the original CSPP proposal favored 
a lottery system, to determine which 'schools children should. attend. 1 
Parents succeeded in obtaining a "squatter's rights", provision which . 



guaranteed every child a place in the school i s/he was presently attending. 
Siblings who had not yet begun school algo had. "squatter's rights:" 

The 0E0 > experimental director .-suggested, that • tfach voucher school 
.'be required to offer at least twc distinct 'programs that parents would 

have a •choice at their neighborhood school. In the first year, there 

* « * * •.*»'*'*.* i 

were a total of twenty-two minischools in the six participating schools. 
Teachers joined together in minischools^ either because they agreed « 

with a'minischool s philosophy or because they wanted -to work together. 

s . • ^ : . . ' , • !" ' - * : ' • 

•■■ Parents "were informed' about the 22 programs ahd 3b out the voucher plans 

J " - • i . - . • t . . . 4 

both in writing and at open-house meetings. \ • 9 

\. ■ , - V . j \ * 

By July, 80% of the parents had. enrolled their children in minischools. 

», . i ■■ j 

Originally, enrollment limits had been forbidden, but • as\applications 

• ! .■-*'. 

• • \ . i p . ; 

came in, classrooms, grew so^large th&t some teachers had to be shifted 

: from one program to another. - As, a result , teachers who had- worked to 



p R I n - ' ^ *«oea«n."»<6^oiuiton "v 
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design and^plan one minischool ended uj> teaching in another . . However, 
inlNovember , 0 76% of the teachers" indicated they were teaching in the' 

program. they, wanted most, and virtually all students began the school . • 

■ .* • - ■ , • *" 

year. in the minischool their parents listed as first choice. 'V 
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B. THE RAND TECHNICAL ANALYSIS PLAN . , • . 

* S • k ' " - ' 

. In February 1972, Rand presented a Technical Analysis Plan for .- 

the 'evaluation- of tihe Elementary _Educat ion Voucher Demonstration (EEVD)-. 

The purpose of the evaluation was , to describe and assess the political,, 

social, economic, and educational outcomes of the Voucher Demonstration. 

The Technical Analysis. Plan set forth the basic hypotheses of the EEVD, 

as well as the basic public policy issues and major evaluation questions 

to be considered. These were organized' into a framework consisting of 

twelve .information categories and forty outcome dimensions. Of these 

40,-30 were political/social outcomes, five related to economic/cost 

factors, and five to education. After considering the design of a large- 

scale demonstration, the plan identified the relevant indicators which* 

helped to specify the value and quality of program outcomes. Finally, 

■ \ ; ■ .. •. . . • r 

the plan presented sources of data , data collection methods, and analysis 

'•"..» . ■ * [ 

techniques. . ' 

1. Hypotheses 

The EEVD sought to generate empirical data to test the* following 
general hypotheses. ^. . ■■ 

• . Voucher arrangements will increase parental choice . Among 
options open to parents were, newly-organized schools , - .« 
parochial: and private schools, and a larger set of existing 
public schools. . ? 

' ■ The Voucher Demonstration will assist* in the development of 

parental preferences . \ Parents would receive inforaat^Lon about 
voucher arrangements and variations in programs, curricula, 

• ^ ... teaching practices /-student composition," and other differences 

v ;, . 1 ' ■• ., - ; ; ; - : ■ ' ,; . . '. : " : ' • « • 

to hel/Shem make rational decisions among programs. 

- ' ' ' ■ ' \ '. ,17" • :. ; • • 

• . - . ... ^ ... .- -> .,.'*. . 

53r^P!5ffl.^.^ro@LI . . 430 L£XINGTON^StREET; • NEWTON. MASSACHUSETTS 02166 



A, 



•, Piarentar influence will increase school responsiveness . , * • 

° * 

Administrators would be motivated to consider parental , 

* ' . . - - ■ . ■ ■* • 

preferences in the areas of program development, optimal 
levels of Stiujent population,' and the indices parents used * 
to measure organizational performance, Administrative • 
responsiveness to parental choice would be an incentive to 
further parental participation, \ 

• .• The Voucher Demonstration will cause school systems to change . 
The most important changes expected were new methods for 
distributing resources among schools and mdre' variety in ■ * 
curricula and programs to*meet .variations in parental 
preference, \ F 

• Student achievement will improve . Increased congruence between 
: parental preferences and school outputs would facilitate the 

growth .'of students 1 cognitive and i^oncognitive achievement. 

• The Voucher : Demonstration will increase parental satisfaction 
with the schools > .>£he factors contributing to increased 

parental satisfaction with schools were*the choices availaile 

• 41 * « b ...» 

knd the increased .control and influence parents Would exert.** 
These would result in higher student achievement and changes 
^ * in school programs and curricula. 

2. . Publifc Policy Issues .'■ • > 

; ■ ^■■";Impli'cl"t'''to^thc«foregping hypotheses is the .assumption that the 
interests^of many groups of. individuals might be affected by both the x 
. processes" and outcomes of^the^EEVD. : A -Students, parents, community members 

and leaders, educators, And pub lic^servants, all had a "stake" in the 
• Demonstration. In addition, the public education^ system, parochial 
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Schools, government institutions , and professional organizations might 

" * ■ • / - • . . ,J * * w ' \ '• • ' ' 

be deeply effected by the EEVD, Other important, but more elusive, ' s 

dimensions; of .public interest, the Demonstration might influence include 

. ■ - economic and efficient expenditure of public resources; 

: J ■ . . " ' < v ' . . ■ ,> .'. : ■' 

- • • amelioration or reduction of social conflict: 

■ •■"•.'■•.« • 

• the effective education of the nation's children; 

© maintenance and improvement of fair and workable relations -■— ■ 

• between citizens and their government. 

■••''»'■' ." " • ' ■ * ' .'v..".- 

Deriving from this complex set of private and public interests 

wds the general, quest ion, What is the* diesirabillty of extending the \ 

voucher mechanism to other communities? To answer this basic question, 

* * • * •* ■ *• 

it was necessary to ask a set of more specific questions:" ' * . 

• What is the desirability of implementing some mechanisms 

^ enabling parents to have a more direct voice in choosing the 
. schools 'their children attend? • 

• Should public policy encourage^ educational diversity , especially 

'the creation of new schools 0 If so, how? 

*■■."* * * . 

• Should some form of public support for private and parochial-* 

* schools be initiated? If so, what form? / 

• • '. • To what extent should "marketplace" incentives be introduced 

. ^ .into education? What form,, if any, should such incentives take? . 
These questions imply one further inquiry:" 

To what extent are (a) vouchers, and (b) the manner in . 
which vouchers were implemented in the EEVD, a necessary 
- and sufficient device for attaining "the objectives of public 

- ■ # t "* - ■ - , .. . " . ■ ^ .' . . . ' ' .. ■ . ■ 

policy, including those which are the subject of the questions 
above? ■ • • 
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3. Ev&Iaiatloh Questions and Information Categories 

. ■ , ~ ■ , • ■ [ *~~ ^ * 

The A^y propositions of the EBVD's- theory and. a review of the , . ."' 

public' policy questions this theory Spiled posed questions for the 
evaluatiota »td address.' * 

o ^at* has. been the effect of the Demonstration on the 

) education of elementary school students, especially the % . r " 

disadvantaged? v . . •, • — 

• WTiat has been the effect of the Demonstration on the 
available range of choice -among educatipnal programs? * '' , r 

• ' ypiat has been the impact of the Demonstration on equality 

cf educational opportunity? 
© . What has been the impact of the Demonstration on the economics 
. • cf public education? ■. - 

• Eow, has' the Demonstration affected the relationship between 
.citizens and their schools? . 

• What has been the impact of the Demonstration on social 

•V and political tensions? Before the broader implications 

Of public policy could be, addressed, it was necessary to 

• . t . 

% - find comprehensive answers to these questions. 

Twelve information categories were selected to aid in the collection 

y , • • 

>.* * * • 

of information bearing on the major questions of the evaluation. These 

categories helped to -organize large" bodies of data in a way that maintained V ' 
their relationship to the ultimate purposes of the/ evaluation. Figure 1 shows 
the linkage between the information categories and major evaluation questions. 
A. Evaluation Outcomes • * J 

The outcome dimensions of interest' to the evaluation were suggested by the 
theory, and design of the -Voucher Demonstration, by the major questions posed, and 

by the information categories. The relationships of the outcome dimensions to' 

the information categories are shown in Figure 2. 
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Evaluation questions 



!•. Education. of elementary 
school students 



2, Range of choice among' 
educational programs 



• . 3. Equality of educational 
opportunity 

4, .Economics of public 
education ' *V • 



5. Citizen-school relations. 

'6. Critical social and 
political tensions '-V 




: (X indicates that to answer the evaluation question data of 
the specified type ii required) . 

Fig. I- .—Relationship of information categories to major questions of. the evaluation. 
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FIGURE 2 : Relationship of Outcomes Dimensions to Information Categories 
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5. DesiRn Considerations y 

> . * • ■ '. ' ' .... 

.-■> The objectives of the Demonstration included tracking 1 its effects 

oil, knowledge, attitudes, motivations, and behavior, as well as on the 
social system. Target group*Tand institutions included parents, other . 
.■members of\the Demonstration community, educational officials ,and ' 
administrators, teachers, private educational entrepreneurs, schools, 
and community^ groups. To capture the variables relevant to these complex* 
and diverse program objectives, an open-ended design Was needed. An 
evaluation plan Which established causal links between well-defined 
independent and dependent variables could not be employed in a large- 
scale social demonstration where principles of experimental design 
cannot be rigorously, applied . * 

- \ ' \ i ■ , ■ v . - 

In addition to the. multiple program objectives of the Demonstration, 
there werta- wide-ranging and diverse units of analysis. Where the' 
unit of analysis was the individual, the attributes studied could be " 
absolute (about the individual, alone or concerning the, individual 's relation- 
. ship to others), comparative (in which the individual was described ' * - 

relative^ to others on some attribute (s)) , or contextual (where the 

' n - ■ 

individual was described iri terms of .a larger social unif in ^which s/he 
resides). If. the unit of analyses is collective, the properties of 
interest can be analytical (about members of the unit), or global (data 

on the group as a whole). -i „ 

■ ■ :\, \.. .- .• . ^ . " " • \ • 

; The 4 evaluation plan provided a "decentralized 11 approach to major V 

evaluation tasks. Specialists' from various disciplines concentrated on \ 

■ * . '. ... ^. ■■•"*■ i ■ • . - « 

alrptopriate data collection and^anal^is* tasks. . Their f indings were brought \ 
together in an interdisciplinary analysis of aggregate outcomes. 

: ; - > • ; A, % ' • ■ ' ' 
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6. Methodology \ 

•h • •' • . ' * . : 

As indicated previously, the 40 outcome dimensions were subdivided 
into three types of outcomes: social/political outcomes; economic/cost 
outcomes; education outcomes." f Tables 1, -2 and 3 summarize the complex 
methodology Rand used to analyze the numerous outcomes of the EEVD. 
Specifically, the tables present the indicators ussd to measure each 
Demonstration outcome. Thfey also include the sources of data, the 
method. of collectibn.Nnd the preferred analytic technique. Finally, 
Table 4 cites the type of data collected during each year of the Demonstration. 



TABLE 1 

SOCIAL AND POLITICAL DATA 



Political/Social 
Outoome Dlmamlona 


Indlcetora 


Date Sources 


Dsts 

Collection 
Methods 


Preferred Deta > 
.Anelyels Techniques 


Frectitloner aeeetsaente 
of 'local schoola • 

• v 


Expraaaed ettltudee toward 
relative aarlta of own achool, 
Idcel echoole, echoole elee- 
vhere; Judgments of most elg- 
nlflcent echool probleee, 
echoole 1 uee of public* money. 
School, per eonnel trenefere, 
redone for tranefer. 


School perepnnel 
Tranefer recorde 


Interviews j 

Inepectlon otj 
trenefer recorde 


Inscriptive snslysls 

■ ' * $ 


educational goala of 
practitioners . 


Expreeeed ettltudee toward im- 
portence of educetlon, echool 
ve. perent contribution to 
educetlon, nejor'elms. 


School personnel 


Intervlewe 


Descriptive anelyels " 


'recti tloaer op Intone 
about echool integra- 
tion . 


Locel echool current etu- 
dent dletrlbutlone; expreeeed 
ettltudee towerd importance 
of echnlc/reclal identity 
between ecudente, teechere, 
adnlnlatratora; opinione ' 
about current dletrlbutlone 
of ethnic, racial groupe. 


School pereonnel 
School recorde 


Intervlewe 

Inspection of 
achool 'records 


Deecrlptlve enelysle ^ 

~& ■ ' 

. o 


'recti t loner oplnlona 
it out EEVD . 


Expreesed attitudes tovsrd 
echool problems, parent role 
in echoole » alternative 
apeclel proiraaie in echoole; 
expreeeed judgmente about 
who beneflte aoet froa. 
EEVD. . 


School personnel 


Interviews 


Deecrlptlve & analysle 


«ocus and acopa of 
authority for policy 
origination, ratifica- 
tion, «nd Implementa- 
tion for the demons trs- 
Tion arse • 


Cherecter and Impact of policy 
decisions originated, rsti- 
fled, end Implomsntad for 
- demonstration arae by diatrict 
echool board, EVA', prof ee- 
elonel organlzatlona , citizen 
groups, and fsdsrcl end stats 
legleletlve end exf cutlve ' 
bodies.. 


Recorde end minutes v 
of District school' 
boerd, EVA, profee- 
elonel orgsnizstlo'ns, 
an^ citizen'e groups 

Diractlvee, statutes, 
ordere, policy reeo- 
lutlone, and guide- 
lines promulgated 
by federal and etete, 
legleletiva end execu-. 
tive bodice, Dletrlct 
echool board, EVA, end 
other groups 

(cont'd.) 


Inepectlon of 
public recorde 

Inepectlon qf 
neWepepers 

Personal inter- 
vlewe 


Polltlcel and hletorlcel 
enelysle 

Content analysis ' ■ m ' 

t ■ v ' '" c ' 

■ ■ - o 
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• TABLE 1. (cont'd) 

"■*•. 

* « 




Political/Social 
hitcome Dimensions 


i . - 

Indicator! * - 


Data Sources f 


Data , 
Collection • * 
Methods 


Preferred Dsta 
Analysis Techniques • 


(cont'd.) 

. . % ■ 


<f - 


Records of federal 
arid stst* legislative 
hearings and debatea 

Personal recollections 

! — — rfafr — 


• <s&r ■ 


a 


Etelstlonshlp of Che demon- 
■tration area to federal, 
atate, arid county regu- 
latory and administra- 
tive agandaa. 


Scope and frequency of 
administrative regula- 
tions Jpplying to and 
proaulgated for demon- 
stration area by various 
agencies. 


Records of District 
School Aoard and 
EVA 

Published regula- 
tions of adminis- 
trative agencies 


Inspection of 
public recorda 
** a * 
Personel inter- 
views 


Political and historical 
analyala *•* 

Content analysis 




* * 


Personal accounts 
? of Diatrict, EVA, 
and administrative 
agency^stsf f 


y 




U location of day- to- 
day d eel a Ion, making 
authority in demon- 
aeration area*. 

>. «■ • * . 


Laval of operational 
detail for which formal 
rule-making perogatlvea 
are maintained* or assumed 
by ".District School Board 
and /or EVA, District- or 
area-level professional 
staffs, building, level 
administrators p tsachera, 
paraprofesslonala, citi- 
zens 1 groups, students. 


District School Bosrd 
and EVA records « 

Records and files of 
"District-and 
area-level pro- 
fcsslonsl stsffs 

Records and files-of 
building-level sdmlnls— 
. trstors J* 

Personal knowledge of 
District School Board x 
and EVA member's, Die- - 
trlctVand area-level 
etaff, building 
administrators, 
teachers, parapro-* ' » 
fesslonala, cftlxena . 


. Inspect op of pub- 
lic records, minute! 
of meetings and fllei 

Personal inter- 

Classroom, school # 
> and community 
observstlon 


Political and historical' 
analyala 

Content analyala 

• r • * 




* 


Unrecorded declalona,^ 
directives, and aaaum- 

* ptlona of authority by . 
school personnel st 
♦various levels of re- 

# sponsibillty • 


% 

* ' ■ 

•* 


• • 


* 




CI aa s room,^ school, snd 
community observation 
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TABLE 1 (cont'd) 



Politicsl/Socisl 
Xitcomc mansions 



Uialnlstrstlvs orgsniis- 
tion, practicse, and 
bshsvior. 



School stsfflng pSttsrns and 
orgaiiMjation. tf . 
keefionslveness of deaon- 
atrstion sres and school 
adainistrstors to student 
needs, perent concerns, 
and easrglng sducstiond 
issue's. iCritsrist , 
ebility to idsntify needs 
and problems, snd undsr- 
■tand issuss; spssd, 
appropriateness, snd 
af fsttivsness of re- 
sponse, '.ability to shift 
objsctives or aeensUn 
response to new informs-, 
tion.] 



Ugsl/constitutional 
raaificstions. 



position of -prof ss- 
alonsl educator^ in 
community socisl systsa 



Legal sctions associstsd • 
with EEVD provisions 

Court rulings 



Influence on community ex- 
penditures, allocstions, 
acceaa to revarda l*>"*- 
tary, coaaunlty prsstigs) 
ststua' prsrogsjives. 



School records, . * 
■eaoranda, and 
ataff directives* 

Records of demon- 
at rat Ion area 
■dainSfrstlon , 

Prans accounta 

j Peraonal vievs 
and experiences 
of deaonatrstlon 

| area and school 
adalnlstrstors 
snd psrsnts. ■ 

Students achieve- 
I sent records 

Discussions snd 
I dsbstes saong 

adalnlstrstors 
I and between 
I parenta and' 
I adalnlstrstors. 

Observed behsvior 
I of school snd 
] deaonstrstlon sres 

adainistratora. 

I Court racorda 
I * 
Newapspers 

iWlevs of attorneys 
and partiss to 
legal sctions • 

Published court 
1 opinions 

I School personnel, 
I coaaunlty leaders, 
officials 
Public rscords 



Dsts 

Collection 



Inspection of / 
demonstration 
. area and school 
records and files 

Inspection of 
newspapers 

pereoasl J.nter- 
viewa 

Surveys 

School, clasarooa, 
and coaaunlty 
observation - 

Student achlsvs- 
. aent teata 



Preferred Data 
Analysis Technique^ 



Political snd historicsl 
analysis 

Content snalysis. 

Appropriste ststisticsl 
enalyaea (eurvey dets) 



\ 

Inspection of cour 
records and public 
documents ' 
Inspection of nevs- 
pspsrs 

Pereonel interviews 



Interviews 
Coaaunlty observs- 
tion 



".Politicel snd legsl snslysis 
Content snslysis 



Content snslysis, descriptive 
anslysic 



) 
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TABLE 1 (cont'd) 



olitical/SociU 
tcome Dlmcnalona 


Indicators 


Data Sources 


Data 

Collection 
Methoda 


Preferred Data 
Analysis Techniques 


atus perqulaltea within 
chool lyitici. 


Influence on budget alloca- 
tions, access to rewards, 
control ofentry to pro- 
fission, control over rules 
of school assignment, trans- 
fer salary increments 


School personnel i 
teschers' unions, 

NEA ®> 


Interviews, 
' organization 
records, school 
records 


Descriptive analyele 


hnlc/raclal/lncome 
iatrlbution of Btu- 
enta In demonstration 
choola. 


Numbers of students in each 
ethnic, racial, income 
group before/after each 
school choice period; 
ethnic, racial! income 
distribution of student 
transfers. . .• 


School records , - 


a Inspection of 
records 


. Dsacrlptlva analysis 


rent Judgment a of aduca- 
16nal opportunities for 
neir cnnaren. 


Expressed attitudes toward: 
.child's response to school, 
congruence between parent* 
desires .for child 'a educa- 
tion and what schools 
provide; expressed 
tapir ations/cxpectationa 
for educational achieve- 
ment of their children. 


— ^ *> " — - — 

Parent weapon d- 
ents \^ 

parent grciupa^^^^ 


Survey * 
Interviews 

« 

* 


Appropriate scaling and 
other statistical analyaia; 
descriptive analyaia 

f " 


rent aaeeesment of 

9cal schools. 


Expressed attitudes toward: 
relative merits of child's 
school ( other a choola in 
achool district, achools 
elsewhere; achools in rich 
neighborhoods versua poor 
neighborhoods; public 
versus, private informa- 
tion about schools; schools' 
uae^of^public money. Ex- 
preaaed reasons/ for deci- 
sions about child's school. 


Parent respond- 
ents . " 

Parent groups re- 
lated to .schools 


Survey 
' Interviews 


Appropriate' a caling and 
other atatiatical analysis; 
' descriptive analyaia 

■ ' ■. ' .\ 


rent .opinions regard- 
ig raclal/ath»lc 
itegration iftha 
:hoola. ■ 


Expressed attitudes 'toward 
the proportion of atudsnts, 
faculty i administrators who 
should be of the same ethnic 


Parent respond- 


• Survey 


Appropriate scaling and 

other atatiatical analyais; i 

dsscriptive analysis 


ents — '—■ — — - 
School records 


~~ Int e rviey_s_^^ 


"■ ■ '■ 


background as j child; reasons- 
for child 'a problems In 
school;* reaaoha. for achool 
selections (compared with 
atudent teacher ethnic 
distribution; reasons for 
mobility), / 


Parent groups re- 
lated to* schools 


Inspection of 
• school records 
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TABLE 1 (cont'd) 



political/Social 
utcome Dlwuloni 

■rant eeeeeemente of 

the EEVD. 



Indlcetore 

Expreeeed attitude! toward 
congruence between perente' 
daalrad and experienced con- 
trol ovar echoole, batvcan 
information about achoola 
daalred and provided by EVA* 
between echool preferencee 
and achool eeeignmente, 
Letween information about 
achoola provided by EVA v 
and perent experiencee vith 
thoee echoole; expreeeed 
willingneee ovar ti»e to , 
take varloue ectlone to 
influence achoole; ex- 
preeeed Judfmente ebout . . 
who beneflte moet froa 
EEVD. 



Perent pert icipet ion in 
the educetlon of their 
children. 



Perent involvement in 
school-related ectlvltlee 



Pete Sourcee 

Perent reepond- 
ente v 

Perent groupe re- 
lated to echoole 



Reported behevlor in de- 
gree end eubetance of 
interectlon with child 
ebout echool i in perent/ 
teecher contect; reported 
knowledge ebout chlld'e 
echool end echool ex- 
perience; expreeeed . 
ettltudee ebout role of 
perent in educetlon of 
child. , , " ■ „ , 

Steted pertlclpetlon in 
tchool-releted orgeniia- 
tione, ectivitiee* event e; 
in diecueeiona ebout echoole. 
Reported levele, eubeten- , j • 
tive leeuee end outcomes ■ - 
of perent efforte to in- ; 
fluence achoola. Reported 
level of knowledge ebout 
schoolo in* echool dietrict 
"end aleewhere. 



Perent reepond- 
ante 

Minutee of perent 
meetlnge • 
School-rale ted- 
parent groupe 



Date 

Collection 
Hethoda 

Survey 
Interviewe 



^Survey 



Survey 

Interviewe* 

Inepection of . 
group minutee, 
propoeelei ate. 



Preferred Date 
Anelvela Technlquee 

Appropriate' ecellng end 
other etetieticel enelyeie; 
deecrlptlve enelyeie 



Appropriate aceling end other 
atatlatlcel enelyeie 



Approprieta ecaling and other 
atetletlcel enelyeie; content 
analyele. deecriutiva enelyeie 
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TABLE 1 (cont'd) 









*• 


■ ■■ ' ■ * 


PoliticU/Socisl 
Outcome Dimension! 


Indicator ■ 


Data Sourcei * 


fists 

Collection 
' Methoda 


Preferred Data 
Analyoia Techniquea* 


Parent nobility. • 


Number o£ parents moving 
within, into or out of 
demonstration area and 
.. thalr reaaona. 

• 


Parent reapond- 
anta 

School records 


, Survey (plua 
special out- 
migrant vurvay) 

lnapectlon of 
school recorda 


Daacrlptlva atatlstica 

* 


Pi rent involvement in 
ECVD optiom . 


i 

Reaaona for daclalona 
regarding children' a 
achoola; type of change 
in aelectlon (erg., 
public to private, 
existing to new, etc.); 
transfer a from achoola 
after initial aelictloor 


Parent respond* , 
ante 

wCIlUUX t BCD cuB 

< 


Survey 

lnapectlon of 

j BLI1UU1 IflCDiQI 


Appropriate atatlatlcal ' 
aealysls; deecrlptlve 
atatlatiaa ^ 

* • • 


lacal achoola. 


Expressed attitudes . toward 
relative merits of local 
achaola aae* achoola alae- 
where, toward 'achoola In 
rich veriui poor neighbor- 
hood! , toward public ver- 
aua private information 
about schools; expressed 
attitude! toward. achoola 1 
use* of public money. 


Community reepond- 
anta 

Comnunlty leedere 
f 


Survey , 
Interview* 

-. 

. j 


Appriprlate statistical 
analysis 


Community attitudee 
towerd education, r 

* 


Expraaaed. attitude a about 
the importance of educa- 
tion, congruence between 
what children ahould ba 
learning and what schools 
teach. ■; E 


> 

Community respond- ij ' 
ante 

Community leadere 


Survey * * 
r" Zntervlewa 


Approprlsts statistical 
analyala; deecrlptlve 
enelyala 

' V M. * .. 


Community opinions about 
racial, a thai c integra- 
tion in* the achoola. 


Expressed atcitudaa ■toward" 
vhst proportion of students, ■ 
faculty, adalalatra tore ' 
ahauld ba of aarna ethnic 
backgraund ■■ children; 
., abaut moat ilgnlf icint , 
problems in community. , 


Community respond- 
ent ■ . 

Community leadere 


Survey 
Interviews > 


Appropriate ststlatlcel 
analysis; deecrlptlve 
anslysis V 


V ; . / , 

IF-'}. • % 


■ . ,* • ' •*** . 
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TABLE 1 (corit f d) 



olltlcai/Soclel 
tcoeja DlpgnaloneA. 



Indlcatore 



eamnlcy aeaeaarente of. 
ha EOT. 



>iBunity ettltudee 
toverd political 
ictlvlnau 



ntar-6r° tt P conflict/ 
coepsratltn. 



Political and aoclal 
participation. 



Expreeeed ettltudee toward 
• congruence between control 
paranta ahould axardaa 
ovar echoole and control 
permitted by EEVDJ aa- 
praaaad Judgmante about 
who banaflta «oat fro» 
EEVD; expreeeed oplnlool 
for EEVD, to continue 
bayond deaonerratlon 
pirlod. 

Expreeeed propensity toward 
political ■o.blUaatlon with 
raapact to achoola; ex- 
preeeed Judjmanta about 
axaatplaa of group ect lone 
af {acting achoola. 

Attltudet and poaltlprfa of 
group opinion leadere; * 
group public poaltlona on c 
leeuee; group political 
tctlvltlae and af flllatlona; 
i othar group attaapta to ln- 
fluanca public pollclaai - 
group actlvltlaa In achoola. 



Voting rateo 
Voluntaar political and 
saapalgn activity 

Group ■eaberahlp and 
activity l«vala 

Ulttei ^ilfilClpitlOll 
in echool 

Voluntaar achool- 
ralatad actlvltlaa ^ 



TiBt* Sourcaa 

Coanunlty reepond- 
auta 

Coonunlty, laadara 



Data 

Collection 
Hathoda 

I Survey 
Intervlive 



Prafarrad Data 
I ' Analyele Tachr.Uuet 



Appropriate atatlatlcal . , 
analyele, deecrlptlva analgia 



Comaunlty reapond- 
ente 

Cowaunlty leedere 



Survey . 
Xntarvlewe 



Obeerved group 
actlvltlaa 

Newepapar eccouote 
of group actlvltlaa 

Mlnutaa and recorde 
of group and public- 
meet Inge ^ 

I Pereonal obaervatlona 
of group leadare, achool| 
edalnlatretore, EVA 
Msbare, and othar 
declelonaaVere 



Xnapectlon of 
public end group 
recorde and fllaa; 
1 of newapepere 

Pjreooal Inter- 
I vlawe i 
CoBBunlty obaerva- 
tlon 



Voting recorde 
Recorde end »lnutaa of , 
political and aervlce 
organisation* and 
groupe ... 
Pareonal knoyladga of 
cuamunity walarg t 

Pereonal knowledge of 
organisational and 
grdup laadare' 
Obeerved behaviour of 
eoaamnlty »aabare 

(cont'd.) 



Ilnepectloa of 
recorde, »lnutae; 

I newepapar a . 

I Pereonal , Intar- 
I vie we 

Isurvaya 

ICoaaunlty obeerva- 
Itlon 



a3 



Appropriate ecellng and other 
atatlatlcal analyeles 
deecrlptlve analyele 



Political and hlatorlcal 
analyele — 
Content analyele 



Political and hlatorlcal 
analyele 

Content analyele 

Appropriate atatlatlcal 
aoalyelo (aurveye) 
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TABLE 1 (cont'd) 



oliticel/Socijl 

itoome Dimensions ^ 


Indicator! 


Data Sources 


Dats c 

Collection 
Methods 


-Preferred Dsts 
Analysis lecnnx^uBi 


ont'd.) 


• 


Hlnutes end -records 
. of public meetings 

Press accounts 

Personsl knowledge -\ ? 
of school personnel 


9 

■ ' " '> 

1 


^- . ■ . 


lltlcal mobilisation. 


formation of new groups 
or coalltlona around 
EEVD-relstsd issues 

Actlvltstlon and/or 
expsnalon of axlitlng 
organization! ..around 
EEVD-related issues* 

Emergence of new poli- 
tic il leader ship around • 
EETO-relitid Issues 


Observed behsvlor of 
groups snd group 
Is ad era 

Records. and minutes •* 
of group and public 
meetings 

Views of community • 
-leedere, rsspondents 

Press sccounts 


Community observa- 
tion — 

Personal inter- 
. views 

Surveys 

Inspection of public 
snd orgsnlsstlonsl 
. records a newSpspara 


-Content snalyala 

Appropriate ststlstlcal 
analysis (survsys)^ 

rolltlcsl snd hlsterlcal 
analysis ^ 

V. * 


ting bihivlor on key 
■ luei (incrsssad 
ocally funded ex- 
anditureo for aduca- 
ion, availability of 
ubllc fund a to 
arochlal school a , 
ntegratlon, and re- 
atad Ibbubb, provi* 
Ion of new incentives 
o entrepreneurs). 


i 11 

Votes on educstion- 
rslated ballot measurss 

Election outcomes for 
political candlditii 
identified with various 
issues 

V 


Voting records, by 
precinct views of 
community leedere 

Views of community 
raopondenta 


Inspection of voting ' 
records 

Personal (ntir> 

views 

Public opinion polls 
Surveys 


Peliticsl and historical 
analysis 

Contsnt analysis 

Approprists ststlstlcsl 
analysis ' (surveys) 

• jf . 


lltlcal. mobilisation 
eyond demonstration 
ria 


Voting behevior on modsl 
and political issues; 
organizational activity 
almsd it reform of other 
'community problems, at 

* educational reform in 

* non-demonstration schools; 
emergence of issues such 
as voiichsrs for othsr 
public services* 


Community leaders* 
officials 

■ Voting records . 

School administra- . 
tors 


Interviews 

Inspection of 
records 

, Community' observa- 
tion 


Descriptive snslysls 
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TABLE 2 



ECONOMIC AND COST DATA 



tonotaic and 
:ost Outcome 


Indicators 


Data Sources 


Data 
Collection 
Methods 


• Dvaf arrOfl flat** 

Analvsls Techniques 


Dimensions ' 

itructural changes 


Demand changes 


Parent responses , 


Surveys 


Statistical tabulations , 


in Educational 
Marketplace 


Changes in a number of 
feasible schooling 
options * 


Parent responses 
' Observations v >■ 


Surveys 
Observations 


Historical and descriptive 
analyses 




Product diversity. and 
differentiation 


School reports to ISA 

on curriculum, etc. - 
School observation 
Interviews with school 


See data sources 

* » 


Curriculum consent analysis 

Historical and descriptive 
analyses 






officials J 








Changes in barriers 
to entry 


Cost data 


Interviews' 
ISA records 


Statistical cost analyses 






Legal codes and 

regulations 
Public school organize- 9 

tlon and distribution 

of authority rules 


* 

Interviews 
Interviews 

/ 


Historical and descriptive 

analyses 
Historical and descriptive 

analyses 


Behavioral changes 
among suppliers of 
educational services 


Changes in information 
desired/available to 
parents 

Changes in school 
selection policies 


Parental responses 
School records 


i 

Surveys 

Reports and records 
Observations 


Statistical tabulations 

■ ■ *. .■ *~ ' * 

Historical and d*2 crip tiye 
analy^os * 




Changes in. investment 
policies 

Changes in tuition 
policies 

Changes in admission 
policies 

Changes in educational 
offerings 


School reports to 
EVA and other school 
records 


Reports and records* 
Interviews * 


Historical And descriptive 
- aral^e:i .. 
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TABLE 2 Xcontjd) ' ''! >■/ •^'v.; ; < * ; / 



/ 


Indicators ' 


Data Sources 


Data 

Collection 

Hethods 


Preferred Data 
Analysis Techniques 


aance 


Parental satisfaction 


Parent responses. 


Surveys. 


Statistical tabulations 




Prices, cost nsrgins 
and profits 


School records 

• 


Reports * 
, Interviews' 

• t 


Statistical tabulations 

Historical and daacrlptlve ,. 
analyaea 




£ales proration costs 


School records 


Reports 
Interviews 


Tabular cnalyaea 
Historical and descriptive 
analyses ■ ' 




Rates of innovation and 
curri cuius change 


School records - 


Reports 
Interviews 


Historical and descriptive 
analyaea 




Responsiveness to 
parental -demands 


Parental vieva 
'School records 


Surveys 
Interviews 


Historical and descriptive * 
analyses 




•Entry into and exit 
ftdm market,' 


EVA records V 
Community observation 


Reports ' 
Interviews 


Historical and descriptive 
snalyses 


cation 


Currlculun changes 


School records 
(schedule of clssses) 
(recommended lesson 
plsns) , 


Reports 

Obssrvstions "* / 


Programmatic ahalysla of 
curriculum and other > 
activitica 




Changes in nix of ' 
reaources 

Changes -in non-inatruc- 
Clonal activities : 

Changes in extra-school 
offerings 


* * 


V 


~ » e 


hangea 


Changes in revenue 
sources 


Budge to % 

Other financial reporta 

a. 


Reports 
Observations 


Budgetary analysis including 
crosswalk 




% Changes in expenditure 
pattcrne 






Historical and descriptive 
analyaea" 



1 
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TABLE ,3 

EDUCATIONAL DATA 



Educational 
AOukcome ' 
r- Dimensions 


Indicators 


Data Sources 


\ Data 
Collection 
Methods 


Primary Data 
Collection 
Responsibility 


Preferred Data 
Analysis Technique d 


Cognitive 
achievement 


Achievement 
test scorea 

* 


Standardized Reading 

Test ' \ 
Standardized Math -.Test 
Dtis-Lennon Mental 

Ability 

Primary Mental Abllltiea 
Torrance Creativity 
Test' 

Performance Scaling 


Paper and pencil 
teat's, and class- 
room performance 

* * 


EVA* 


Strstified sample compariaons of ststus 
and gain scores using varioua * atatis-- 
tlcsl procedures (analyais of variance, 
regreaslon, contingency testa, etc.) 

. .4 • 


Affective \ \ 
growth \ \ 

\: . \ 


Self-report 
inventories 


Sears Self Concept \ 
Coopersmlth Self Esteem 
Myers n-Achievement , \ 
Attitudea toward Self 
and School 

Student Survey \ 
St. John Scale 


Paper and pencil* • 
tests 


EVA 


Stratified sample comparisons of statue 
» and gain scorea using varioua ststls— 
tlcsl procedures (analysla of variance, 
regression, contingency tests, etc.) * 

-* ■ .*.*'■•. 


Education ob- 
jectives of 
barenta and 

: school per- 
t sonnel 


Expressed 
'sttitudee 
and opin- 
ions 


School records, views of 
school personnel and 
parents 


Examination of 
school records, 
personal inter- 
views, Delphi 
Attitude Estima- 
tion Survey 


Rand 

v .. 


Content analysis, sxS statistical tech- 
niques, appropriate to Delphi (analysis 
of varian^*? linear estimations) 


Teaching plans 
an* practices 

^bci^Lgy of 


Formal and 
informal 
program pro- 
cess and 
curriculum 
plans; 

\ classroom 
behavior 


School records, views of 
school personnel, ob- 
served classroom beha- 
vior of teachers 


Personal inter- 
views, examlna- 
tit . of , achool 
records, ^. class- 
room observation 


Rand \ 

at 


Counting, sorting, rating, content anal- 
ysis 

1 • ■ ■ - • . • : : 


1 the ciasaroon 

/ \ \ 


classroom be 
havior and 
organize- 

| tion 


-Observed classroom be- 
havior, students 

i 


Classroom observe: 
tion, paper and V 
„ ^pencil tests 


Rand "IT* 


Counting, sorting, r sting, content anal- 
ysis, sociograms 

(,: . 



TABLE 4 



■ Elementary Education Voucher Data Classified by 
' Type of Data and Demonstration Year Collected 

(Data (X) represent full year. unless asterisks appear) 



% 



I 

3 

ft . 



TYPE OF DATA 

1- 


., DEMONSTRATION YEAR / * , ' ' 


i- * 

STUDENT DEMOGRAPHIC * ' 




107*1^7/. 


1,9/4-/5 


IMF If 

19/5-/6 


1976—77 


x 


x 


X 




■ X' 


\ '• 

TEACHER DEMOGRAPHIC 


V 1 


X 


X 


x 




MINI-SCHOOL DEMOGRAPHIC 


t 

X 




x 


. X , 

* 


V ! 


STUDENT MAT, 


X) 

■ X . . 


x 


x • 


* 1 

X 


X 


TEACHER OPINION . 


• 'x 


x 


; X** • 






PARENT OPINION 


'• X 


X 


X* 


1 




STUDENT PSYCHOSOCIAL • 


t , 


1 




' x** " 




CLASSROOM OBSERVATION 








X** , 





*■ fall/winter administration only 



** spring administration only 
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C. THE IMPLEMENTATION YEARS . - 

Proponents of the voucher system had envisioned a unified structural* :/ 
• change in a school system. However, the Alum RocH District and the • ' 
Sequoia staff, the group hired to implement the Demonstration, lacked' 

' ': ' ? ■ \< ■ 0 ■ •. ■■ 

the resources and expertise to transform Alum' Rock automatically into a • " ' 
voupher system. Mechanisms for operating the Demonstration needed to be "// 
= developed. The proposed new^ budget and information : systems necessary to - \ 
the functioning of the voucher system posed technical problems which 
demanded considerable. time to; solve. For these reasbns,' the\ implementation' ■ . 
of the Alum Rock Demonstration was accomplished .using an incremental * 
apprdach . Thus, the components of the. voucher system- ^parent choice , 
parent information , evaluation , and per pupil budgeting were implemented " 
sequentially. From a political perspective as weil , the* incremental 
approaph' was desirable: if - the voucher system was to function," all parties * 
" involved would have to agree on major decisions affecting theih. Therefbre, v * 

, decisionmaking was a negotiation process among the maj op/participants in 

** ■ '""*•*.■■*■'■.'■ * * 1 "■*»- * ^ < f . • - ■ 

the Demons tr^u ion- Thfe major decisions* and ^events of each year of the N 
Demonstration are described^ in the next few pages and summarized in Tab le 5. 

VI. ,1972-73 (First Year) . . ' ' ; • _ 

. The first ye^r of the* Demons tra,t ion consisted mainly of on-the-job 
. ^ organization s s k mechanism for parent choice was created with the 
> - establishment of minischbols . To encourage parents to take full ; advantage 
^ / * of '^'he Mnischopl options .available to them, program descriptions were 
^-providecr.. . Another major task this first yearvwas to plan an income- 
outgo budget tying ...dollars 'to school enrollment on a continuous basis. 

- : : ;' ' V; 'v : -*"-.' : '.. . - . ' : • , : -\ 

; -v.v- • ■■ " ' - ". _ \.- ■ ^ . *.« •'•"' ; .. ' 

: • .< ■' / •; * l " e> ■■ ' ■ 



y - „ __r.| ■ = ■.'■' O moaxm . *<2>MOf\ArT£ 
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;ar , ! dominant Thane ! 


Voucher Components ; 


Other Related Event's . 


' • ; j • 

'2-,' 73 V On-the-job organi- 
• • zation . i. \ 

■ ■■'w ; 


. Parent choice-expands with establish-. 
ment of minischools • v 
rci pupiji Duageting-pianninK oi voucner 
budget system; $200 per pupil in' : 
'.: extra federal funding • ; ' 
. Established parent information system 

- — : — t-! ; — '• : 1 — — — s- 


Six schools participating (about 5800 
students) •: .';/ • 
Established! Educational Voucher Advisory 

Committee <. ,! '" •;/. 
■ • Central voucher staff; ' : - 

Parent Advisory Committees 


3; '74 Program expansion 
•, and attempt to, In- 
. elude additional ' , 
earlier proposed , 
. .features ' '. 

* ' . v. . 

"if; . * 

'■ ■' > , , ' ' -■■ • v.. 


-. Per pupil budgeting-operation of ore- ; 
. viously planned system; $200 per pupil . 

in extra federal funding; voucher schools 
" (not minischools) began to receive State ~ 
■ Compensatory educational; funds (about 
; , $75 per pupil) , ..' './;.'. ■ 
Parent. choice further expanded as ■ ' 
minischools are formed. 'Six new . 
•programs created, three of which : 
failed 1 atte^lD^p^^ • private school ■ /' . 

; participation failed ' ■ 


Seven more schools joined Demonstration 
£ SatellMrig of popular programs' attempted 
6 and failed . • '•' • \ ' .;/';/ 

Carry-over funds removed'. 

Agreed to fix total school size and, allowed 
■*;' . minischool size to float till June 
-Squatter's rights" abolished . f K '/; : 

Advisory Boards required for all district 
schools '• ■ " , •!■;•■ 

rarent counselors suooramated, to principals 

HRC hired to do communications training. 

Sequoia Institute more readilly.' identified 
•' aslpart'of-the.di8trict ■ „ ; 


■ Iff 

4- 1 75 / Dominated by . 

budgetary concerns 

J, and trend toward . 
recentralization : 
beginning .: •. 

t . ■; v* • ' ' * { i ' 
. /. . . . "'. • v . 

t 


Per pupil budge ting-previous /income- . 

. outgo voucher budgeting system re-.- / 
placed by. a twice annual budget ad- 

f • justment; $100 per pupil in extra ;; ; 
federal funding, ., \ ' ;,; .;V' 
Parent Chbice-51 minischools in opera-. 

■• tion; minischools limited student ; 
"transfers.- . ' ■, 
Parent Information-parents' received: ' 
reports .on student cognitive, per- 
formance and attitudes' toward . 
schools- . ■ t v 


One more school joined , totaling Ik 
(over 9,200 students in Demonstration) 
Local revenue base decreasing, inflationary/ 
district costs, federal voucher . : T T ~ 
•' funding near end ; carryover funds re- . 
, moved again / . ; ' .".; /"v// 
-Teacher /aide layoff s adversely affecting; /j; 

minischools V : . .. i : - 
Class sizes fixed . //';/.':.■• ;./• '. ■■H 
Consumer interest in minischools decreasing 
Minischool size maintained '/■ '■';/'■■'' 
50% of original Advisory. Boards still 
• /functioned/ / v : 'V \;/; / ■ ', . ■/•■ / /'./ 



TABLE 5 (cont'd) 



iminant Theme 


Voucher Components 


Other Related .Events 


<> 

hpol* recentrali- 
ttion continuing; . 
nicher concept 
luted . 


Parent Choice-minischool diversity 
eroding as programs per school were 
limited to three; schools' given option 
to return to single school-wide edu- 
cational program; planning and budget- 
ing done at -school level rather than 
minischool level 

Per pupil budgeting-$100 per pupil in ' 
extra federal funding 


Size and number of minischools maintained 
Minischool autonomy lessened 
Voucher-funds allocation to total not 

minischool 
Non-voucher schools given the option to 

offer multiple program? 
Merged discretionary funds into one pot 

and allocated to schools based on . 

achievement scores ~ 


ucher concept : 
ving way to 
ltiple option 
stem * 


^ Parent choice-twenty school-wi thin- 
school alternatives . - 


Seven of the fourteen Voucher schools 

continued minischool form of organi- 
zation; two nonvoucher schools 
joined 

District termed all of its schools 
"alternatives 11 


perimeht with 
rent choice; * 
ong distinctive .. 
ucational programs 
s ended 


1 ~ ■■■ 

Parent Choice^only two schools were 
offering more than one educational 
program; open enrollment 


* 

— .A- 
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Other operating mechanisms established' during the firs.t year 

were a central voucher staff and the Educational Voucher Advisory 

•'* '••.*■ * 
Committee (EVAC) , an Advisory group composed of voucher parents and 

teachers. . 

2. 1973^74 (Second Year) '\. 

The second year was characterized by program expansion find; attempts 
to include additional earlier proposed features of the Demonstration^ 
In the first year, six. schools and 22 mihischools had participated. 
• During the second year, 13 schools and a total of 45 miAischools 

» - v V ■ 

" ... . ■ . * o 

'participated. Attempts to satellite « i.e., to expand enrollment in . 
-popular programs by annexing available space, failed due to management 
problems* The school district also tried to decentralize utilization of 
curriculum coordinators and psychological services to the minischool level. 
-However, the district incurred financial losses by paying- salaries of 
personnel whose services had either not been used or had not been charged « 
properly. ' - . 

The operation of the. previously planned income-outgo budget was an 
important part of the second-year effort.. The budgeting system worked 
well technically and was expanded to all schools in the districif during 
^ year three 

After extensive negotiations with teacher organizations , : a /private \ 
schooTwas finally admitted to the. Demonstration. Uiif ortunately , the 
long delay caused many parents to lose interest; ultimately v the school 
did not participate due ; to under enrollment.; 9 

At the end of the second year, three new programs had been created 
and three previously created" programs had failed due to lack o£ demand. 
Parent choice was expanded by abolishing squatter's rights which had 
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guaranteed every child a neighborhood school. The fragmentation and 
suspicion previously existing among-the central staff, Sequoia, voucher 
and nonvoucher -principals had abated. The Sequoia Institute became identified 
as part of the district rather than as an outside group. 

3. 1974-75 (Third Year) ' : . ' • j 

f Budgetary concerns dominated the third year of the -Demonstration. 
As the end of federal voucher funding drew near, the local reyenue . ' 
base was decreasing ,due to declining enrollments and district costs .were 
mounting due tcf inflation. Teacher layoffs , an inevitable economy .* 
measure, had adverse effects on minischool programs since th^layoffs 
were based on seniority and failed to consider the impact of the loss^of ^ 
teacher^ who had special skills (e.g., bil^inqual ability) . required by 

'.•*,. r - ' ' * " O 

special programs. • ' t . ' 

Class sizes were fixed to allow tfhe district to predict accurately 

how many teachers they would need. This change meant that programs couldv 

•no longer acquire more, money by enrolling more students. This "carryover" 

money had enabled schools to operate autonomously; when i wafe removed 

■ . ' ■ * . * ■ " ' . ■ • .* ■ 

for the second year in a row, minischools 1 fiscal independence decreased 



V 



substantially . r 

Continuous, income-outgo budgeting was replaced with, a budget 
that was adjusted twice a year. Principals f^lt* that this new ^system 
would give them the\same income and discretion as the older system and 
would decrease the large amount of work frequent budget' adjustments required. 
Although parent advisory committees had been established for. all 

. ..... •; .' ' V > ■•.-;.;•. ..•. „:•. J ■ , . 

voucher minischools, only 50% of these advisory groups still functioned at 
the close of the third year.. K ■ ' ' " 



6^ 



At the end of the Demonstration's third year, a pattern of 
recentralizatioh- was apparently forming at both , the district aqd the 
school levels. At the district level, maximum school and class sizes 
had been fixed, portable classrooms had. been removed, * and a rule that / ' 
schools could not hire personnel in order, to. lower class 3ize had been 
established. These decisions 'to depart from the earlier voucher concept 
reflected the district's response to its precarious budget system. A 
contradiction impeded voucher innovation; the desire to decentralize 
decisionmaking conflicted with an economic need for strong fiscal controls. 

r • ■ ■ ■ 

4. 1975-76 (Fourth Year) % . 

School-level recentralization continued during the fourth year c 
% ... 
of the Demonstration as all discretionary funds were merged into one pot. 

These, funds were distributed to schools, not minischools, on the basis. 

of reading scores, with larger amounts given to lower-achieving schools. 

Arguments for recentralization at the school level were that it 

decreased paper work and .tl^t the previous incentives for a decentralized^. 

system had been removed. Without their own di . ^retionary budgets, principals 

, " . ' , /: . ' . • • ' ' • \ : - 

now preferred to control the total school budget. Fixed class sizes 

and the removal of basic carry-over funds diminished the incentive for * 

miflischools to administer their own funds, especially since most principals 

allowed minischools limited discretion over expenditures. By the 

Demonstration's fourth year, minischools appeared to be losing program 

diversity and their autonomy was eroding *a9 the planning and budgeting was* 

done at the school, rather than the minischool, level. 

; / ' : " ' : '/'.. ' V ' ' ■ \ " ' 

5. 1976^77 :• (Fifth Year)- / . • * 7 

Minischools, the mechanisms for*, increasing parental choice ''among 
distinctive educational^pro grams, , cpntinued on a more limited, basis. As 



mentioned previously, the removal of carry-over funds, the merging- 

of discretionary funds, and the fixing, of class sizes served to lesser* 

the minischools^ power and autonomy. In the fifth year of the Demonstration 

» • / ' 9. 

only seven of the original voucher schools 'maintained the minischool form 
of organization* When these seven schools were joined by two non-voucher ' 
schools , there w6re a total of twenty school-^ithin-school alternatives . 

At this time, the district chose to aalltall of its Schools' 

■v . * \ * • * 

alternatives . The term "alternative" was somewhat misleading, since single- 
program schools served mainly as neighborhood schools which did not 
attempt to differentiate themselves by program t^heme. In addition, only 
25 percent of the teachers in .single-program- schdols preceiVed themselves 
as teaching in an alternative programs * 

6. 1977t78 (Sixth Year) : . 

For all practical purposes, the Alum Rock Demonstration ended in' 
jtHe Spring of 1977. Its original objective, namely, to observe what 
would happen if a. school district gave parents the opportunity to enroll 
their children in , the public or priyate school of their choice, at the 

district expense, was never realized. The Voucher Demonstration became, 

j 

instead, a test of the idea of free parent choice among alternative - 
programs within the public schools. 

By 1977-78, only two schools in Alum Rock still offered more than 
one educational program, although open. enrollment continued to be the 
district policy. The voucher concept .assumed that parents would actively 
use their power of choice to make the system operate for their children's 
benefit and that programs would compete with each other for resources. 
The district's ^experiment did not bear out t his assumption as fully as 
expected. * 
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II. SUBSTUDY DESCRIPTIONS 
A. . DEMOGRAPHIC DATA BASE 

1. Background and Purpose 

Creating a Demographic Data Base was the result of an administrative 
data collection and data processing effort to support other evaluative 
activities performed during the Elementary Education Voucher Demonstration. 
Specif ically,\the demographic data were used by^the Demonstration research 
staf^ to assist in sample selection, to generate class lists, and to 

perform analyses when used in combination with other Demonstration ' 
dat;a. 

2. Sample 

The Demographic Data Base describes three populations : 
minischools, voucher students, and voucher/nonvoucher teachers. The 
entire universe was the target population for each of these groups. 

3. Data Base Designs " _ 

The files comprising the Demographic Data Base were designed by the 
data management contractor (DMC) in anticipation of the research needs 
of the Demonstration research staff. Since the staff required comprehensive 
and. up-to-date information, on minischools , students , and teachers, a 
five-year longitudinal data base was constructed. Several types of 
information were included in this data base. 

• identifying information;- 

• individual and family demographic information; 

' ■ - ^ ... 1 £ . 

• program information (e.g. , dates^of openings and closings, 
tsize, grade levels, etc. ); 

• attendance information; 
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• federal prograw participation; 

• transfer information; 

• 'teacher employment/salary/credential information. 
File-level documents provide-de^ailed information on the structure 

of the Student, Teacher, and MinischdoIrRemographic Files. 

Data for the Demographic Data Base were not generated by a specific 
instrument; rather, they were obtained from a variety of sources, shown 
in Table 1. 

» ** • 

TABLE 6 ' 
Sources of Demographic Data 



Population s 
Minischools.> 

Alum Rock Attendance System (ARAS) 



Students 



Teachers 



Source 

Student Demographic File 
Teacher Demographic File 
Voucher Dollar Reports 

Voucher School Data 
Fields computed from other 

minischool fields 
Teacher Rosters 
Rand Quarterly Reports 

School Attendance Records 
School Registration Records 
Parent Requests for Transfers 

Alum Rock Employee Payroll File 



ERIC. 



M. Statistical Analysis 

In addition to cleaning and merging data, the DMC checked the 
consistency and range of the values of variables in the Demographic Data 
Base. However, no statistical analyses were performed on these data 
as part of data base ' construction. These a were combined with other 
questionnaire data and analyzed in the context of several other Demonstration 
substudiesV 
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5. Findings 

Since no specific analyses of these data were performed, there. 

• ■ * . < * ■ ■ . 

are no findings to report* 

6. File Descriptions ■ 

There are three files corresponding to each population in the 
Demographic data base. 

a. Minischool Demographics 

The purpose of collecting the data in this'file was to track 
physical changes in the Alum Rock school buildings and to N describe 
the operating characteristics of each minischool. Tolmeet ttiis end, . 
such information as location, teachei\, administrator, enrollments, 
number of classrooms, and voucher funds was collected. The file covers 
five years • and contains one record for each- ministhool. 

Year Minischool Variables 

1972- 73 : 26 >. 76 

1973- 74 58 76 

1974- 75 67 76 . 

1975- 76 67 . . 76 

1976- 77 , 100 x 76 

318 

b. Student Demographics 

The data in this file describe voucher students in the Elementary 
Education Voucher Demonstration.' Designed to assist research staff-; ;it 
contains information on a number of student characteristics, among them, 
identification code, voucher status, birth. year , sex, ethnicity, grade, 
school, program, enrollment date* attendance category, handicaps, first 
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language, federal program participation, residence, family status, 
transfers. The data for each of the 5 years of this study have been 

merged and the resulting file contains 33,090 cases and 155 data items, 

. ■'■■«»■ 

c. Teacher Demographics 

Likey the other files in the Demographic Data Base, this file covers 
five years^ Its purpose was also to assist ^researchers: it serves as a 
basis for generating lists for surveys. The .data it contained were often 
combined and analyzed with questionnaire results. It contains data on both 
voucher and nonvoucher teachers. This file contains 1,980 cases- and 73 
data items. 
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B. PARENT/COMMUNITY SURVEYS 

1. Background and Purpose 

The question of parental choice in schooling has been of limited 
interest in the past" because there has been very little variation in 
school decisions. Most American children (89%) attend the public schools in 
their rTeighborhoods; however, a sizeable minority (10%) attend 
parochial schools, and a small proportion (1%) attend other private 
schools (Grant, DHEW, 1973). ' | 

| • • 

When parents were dissatisfied with their child's schooling, their 
range of options have usually consisted of: (a) moving family residence 
to a preferred attendance area, (b) requesting an inter-school transfer, 
'(c) asking fora particular teacher, classroom, or program, (d) going 
^ .outside' the public school system to. a private or parochial school, or (e) 
keeping the child out of school altogether . ; 

While these options have traditionally existed, they have -always been • 
strongly influenced by families 1 financial resources and social 
influence. Families with low resources and little influence have had 

z f '.I * I : 

difficulty taking advantage of the mechanisms necessary to provide 
educational alternatives for thexr children 1 . 

Those in favor of further increasing parental choice, see a number of 
benefits for their children and their families: 

First, some view increased parental choice as ,a means of giving 

I . ' I 

families more control over schools. The underlying assumption is that 

• .•-<• * 

teachers will work harder under such a system, thereby improving student 
performance. % 



430 LEXINGTON STREET \% NEWTON. MASSACHUSETTS }'■• 02166 • (6171 Sfiq-Qifin -V 



; Ye? . ■ 

Second, alternatives in schooling will provide an outlet for those 
parents who hold views different from those prevalent in the public school. 

Third, parent ^erlessness and alienation ^an is. ise 

their participation in their children's schools. 

Fourth, parents may indeed prove to be better at matching their children 
with a specific educational program than the professional educators, thus 

. I 0 

maximizing overall student progress. 

The Educational Voucher Demonstration in Alum Rock California was not 
only an attempt to increase parental choice, it also sought to give parents 

a set of distinct program alternatives from which to choose. The 

■ » ■'*" * 

Demonstration idid so by stimulating competition between schools and 

by creating multiple programs within the public school system. Fostering 



competition/between minischools presumably would improve the quality of 

/ • 

f - v . . • ti . • ■ 

these programs by introducing the market motive into the educational system. 



However, rapid and complex changes in organization and procedures 
occurred in the Alum Rock district as a result of the Demonstration. These 
changes rai y.r <n< <;tions about the problem that other districts would 

encounter in attempting to Implement a system of educational alternatives. 
Among some of the questions on which the evaluation focused in Alum Rock were: 

• How do ^parents react to the Demonstration? 

• Do parents understand their choices under this new system? 

• How do parents exercise their options? 

( To provide answers to these questions, six Thrent/ Community Surveys 
were conducted c the five years of the Alum Rock Voucher Demonstration. 
The six surveys were conducted at the following times: 

a . Fall 1972 , f 

o Spring 1973 , 

• Fall 1973 , .. .'' ■ , y>j y ... ->;■■■ 
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• Spring 1974 , 

• Fall 1974 , 

• Fall 1£76 • 
2. Sample 

New samples of families were selected during October of each year 
of the Demonstration. The respondents to the parent/ Community .Survey 
interviews were drawn in order to represent two factors relevant tc 
the evaluation design: parental status (i.e., parent or non parent) and 
residence (within the'voucher area or outside the voucher area). % . 

Thus, the evaluation samples selected for the analysis of educational 
voucher dem&rfstr at ion were 

• voucher parents, 

• voucher non-parents , 

• non-voucher parents , 

• npn^voucher non parents* 

The latter three subsamples served as control groups. These control . 

groups helped to eliminate the influence of parental status and 

/ / * ' 

residential location on the attitudes and behavior toward educational 

vouchers and to study more closely the effects ofXvouchers on the subsaraple 

of major interest, the voucher parents themselves. 

: A number of supplementary samples were added to the sampling design 

in order to investigate the effects of refusal rates, outmigration of 

panel members, and program/school changing behaviors Thus, samples were 

broadly classified as experimental samples in contrast to the 

purely evaluative samples described above. The major types of experimental 

samples are listed below./ 

, • Outmigrants sample , 

Immigrants sample , 7 8 ^, 
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• Changer sample, 

• Panel salmple . 

lt\ £He fc; lowi^ section, the evaluation and experimental samples 
drawn in eiach of the six parent /community surveys is defined and 
method of sample selection is briefly described. 



a. Fall 1972 Parent/Community Survey 

There were six sub samples in the Fall 1972 survey. 

o Voucher Parents: ' ^Parents who have childreir~attending voucher 

• : • . . v- ; < ■ . • " > . . ■ v\ 

, schools * 

« - * .■ •••*...* * 

• Changers: parents who have children attending 

•voucher schools who changed the school 
, , . ■ that any one of their children in voucher , 

schools attend 



Voucher, Nbn- 
Parents 



Two subsamples 
of fen- toucher 
I&rents: 



Non- toucher, * 
Ibn- treats' 



Adults living, in the voucher area who do 

not have children attending voucher schools s 

Parents who have children in grades K to 8 \ 

who live outsi'de the .voucher demonstration 
area. Two separate subsamples of non-voucher 

parents were drawn, one using block quota 
sampling techniques and the other using proba- 
bility sampling from* lists of parents in selected 
(RECAP) schools 

Adults living outside the voucher demonstration 
area who do not "have children in grades K to 8 



79 



V430 LEXINGTON STREET •! NEWTON. MASSACHUSETTS • 02166 • (617) 969-9460 



70 



- - - * . 

•The two methods used to draw the subsamples were a probability 

method and a block quota sampling technique. Two methods were used 

\ t , . ( ■ ■ . . 

because the probability method would not represent all of the non-voucher 
schools 

b. Spring 1973 Parent /Community Survey 

Six subsamples were drawn in the Spring 1973 survey. 

• ^currxng Changer Sample : This is a sample of families who again 

I exercised their voucher option to transfer the child who qualified them 
j for inclusion in the fall 1972 changer sample. Only six families 
^ere targeted for this subsample. 

• New Changer. Sample : Families comprising this sample exercised' 
their voucher option to change the school (s) or program(s) of one 

or more of their children for the first time between October 1, 1972 
and October 1, 1973. Sixty-nine families were targeted for this 
subsample. / 

• / ■ ■ \ \ 

• Post Changer Sample : These families are a sample of changer families 
from the fall 1972/survey, who still resided in the demonstration 
area and did not choose to transfer the child who initially qu3lified 
them for inclusion in the 1972 changer sample. The target population f< 
this subsample was 50* families. 



• Panel Sample : This subsample of families currently reside in the school 
district and was/ interview^ I in the fall 1972 survey. The target 
group was 150 families. c 



Panel Control Sample : This subsample consisted of parents not pre- 
viouely interviewed. This subsample became part of the panel sample 
for the third wave of th» survey..- Fifty families were targeted for 
this subsample. 

ImmigrantT "Sample : This subsample of families migrated into the 
Demonstration area after the fall 1972 survey bad-been administered. 
It was used to replace members of the pansl sample who* had migrated 
out. 



r 
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Respondents for each of the six groups were selected in a probability 
sampling of lists of parents who met the eligibility criteria. The panel 
sample was stratified by school and ethnicity; the panel control sample 
was stratified by ethnicity alone. Although the Jjimigrant sample was not 
stratified, each iranigrant family was' of the same ethnicity as the out- 
.migrant family it replaced. The changer samples were not stratified by 
the ethnicity of the fall survey because such a distribution would differ 
from the population as a whole and, therefore, bias the sample. 

c. Fall* 1973 Parent/Community Survey 

Seven subsamples were drawn in Fall 1973. v 
» Voucher Parents: Parents who have children v 

attending voucher schools 
People living in the voucher 
area who do not have children 
attending voucher schools 



• Voucher Non-Parents: 



• Non-Voucher Parents : 



• Non-Voucher, Non-Parents: 



• Parent Panel: 



Panel Control: 
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People living outside the voucher 
district who have children in 
grades K-8 in public, non-voucher 
schools 

People living outside the voucher 
district* who do not have children 
in graces K-8 in. public schools — - ~ " 
Parents in the Demonstration - 
district who had previously interviewe 
in November 1972, and/or June 1973 r 
Parent s~who have lived in. the 

Demonstration district* since * 

■■*'.• , ■ • " . -. . 

November 1972 and have 
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not been previously interviewed. 
• In-migrants . Parents who had moved into the 

Demonstration district! since June 

1973. ' . k 

The subsamples for this survey were drawn in two ways: from lists of 
parents tfith children in voucher schools (voucher parents, parent panel, 
control, in-nigrants) or by a random selection of households using a two- 
stage area probability sample consisting first of city blocks, then house- 
holds (voucher non-parents, non-vbucher parents, non-voucher non-parents). 



d. Spring 197 A 

This survey consisted of three separate Subsamples. 



Changer Sample 



• Thanger Control Sample 



Alternate Changer Control 
Sample 



Parents of children in voucher 
schools who changed schools or 
programs during the 1973-74 school 
year 

Parents of children in voucher 
schools who did not change schools 
or programs during the school year 
1973-74 

This subsample was identical to the! 
Changer Control- sample. The f amilies 
within this subsample were used when-: 
ever a family from the former subsample 
could not be interviewed.. . 
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. All' thre$ samples for the spring 1974 survey were selected randomly 

from* lists of parents in the voucher schools. The changer sample 

was selected first and the changer control families were then chosen and 
■»..,'"•. . *„ • ■ . 

1 matiched, \child by child, according to sex, ethnic background/ school, 

program, grade, and classroom. The alternate % changer control sample . 
was drawn in the same manner as the changer control sample, 

e. Fall' 1974 Parent /Community Survey 

Three separate subsamples were surveyed in fall 197 A; „ 

• Voucher Parents : t Parents who have/ children attending 
, . , voucher schools 

• Non-Voucher Parents: Parents living in the voucher district 

who have children in grades K-8 

in public, non-voucher schools, and who; 

have been previously interviewed 

• Non-Voucher Parents: Parents living in the voucher district 

0 ■ who have children in _>rades* K-8 in 

' ~~ public, non-voucher schools, and who have 

. ■ v not been previously interviewed 

The samples for this survey were drawn to meet quotas defined by school . 
building and respondent ethnicity. The entire sample of ^voucher parents, 
and the majority of the sample of non- voucher parents : were drawn from 
lists of voucher parents who had been interviewed during the fall 1972 or 
fall 1973 surveys but who had not been interviewed subsequently. A sufficient 
number of families were dravn randomly for each ^uildin^/ethnicity cell so 
tha£ the completion quota for each cell could be met, given reasonable 
•completion rates within cells. 
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f • Fall 1976 Parent /Community Survey 

The survey sample for this study consisted of three subsamples: 



Old Voucher Parents • 



Voucher 2 Parents 



Non-voucher Parents 



Parents who reside in the 
area defined as "old voucher 
catchment areas" N 
Parents who reside in areas 
defined as "new" voucher catchment 
areas" 

Parents who reside in the non- 
voucher catchment areas 



3. Study Design 

— ~~ The study design can best be described as a grease experiment . 
The Demonstration occurred in a natural setting where random . . 
assignment to experimental groups and laboratory controls were impossible 
to achieve. However, the study design- contained longitudinal elements and 
control groups where possible, and attention was. given to the best 
group assignment possible, given the realities of the situation. N 



The two purposes of the survey design were 1) to obtain sufficient 

\ . ■ - * " ' * ? • c . 

data from\ voucher parents, so that inferences could be made about the ' 

■v" • ' * • • , • ■ ' ■ 

effect of the Voucher Demonstration on parental* attitudes and behavior, 

i ■ J ' • • 

and, 2) |to investigate important methodological issues. that occur in the 

evaluation of large-scale social experiments V ■ . 

" . >• • . . . > 

In accordance with these two expressed purposes, the survey design 

contained both an evaluation and an experimental component I To accomplish 
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thi's first purpose (evaluation) , it was necessary to isolate the impact 
of educational vouchers on voucher parents. This involved collecting / 
data from other populations likely to be affected by the demonstration, 
namely non -parents and parents in non -voucher catchment areas. Thus, 
four subsamples consisting of the focal group voucher parents and three 
control groups formed an experimental design which crossed two factors: 
parental status ,and residential location. (See Figure 3-) 
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EVALUATION DESIGN 
Parental Status 



Residential 
Area 





P 


NP 


V 


X 


o 


NV.' 


0 


0 



X = focal group 
0 = control group 
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Figure 3 



In order to determine how parents felt about educational vouchers, • 

V' ' . - ' - ■ 

whether ^they understood them, and if they used them, the survey design 
investigated several methodological problems associated witl/ . the evaluation ■ 
of social programs. This, investigation represents the experimental 
component of the design.' It was experimental ^bec'aiise , while it was not 

necessary for the evaluation per se , ttfe methodological investigaticui 

•'•<•■ i 
attempted to discover alternative approaches to- the evaluation. * - 4 

. • ■ • v. * , 

Three experiments were performed in this phase of. the sfcddy: the 

• - * »* 

J panel experiment, the changer -experiment, and the probiability 1 sample - 
block quota sample (experiment; 

The panel Experiment attempted to -contrast the relative merits of 

' - \ -V . • \ ] ^ ' * - • ■ 

a 'panel design versus §n independent sample design. *This experiment explored 

* ■ • 

the factors that led to attrition and the extent to which inferences from 

\ . ' '\*. ■ " - r ' ■'■'■'] 

panel designs tended to be biased ^because of attrition: * t ' 
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The changer experiment sought to develop a model to predict school . 
changes and to explore the reasons parents changed their children's schools. 

The probability sample-block quota experiment was influenced by 
Sudman (1968) who has contended that block quota sampling techniques 
are more cost-effective than probability sampling methods. Sudman*S 
impression was formed using national level data; the voucher study 

sought to test his hypotheses on the local level. - 

*■ • . 

4. Statistical Analysis 

The Parent /Community Survey data were analyzed' using a 
variety of statistical techniques. Much of the data in this survey 
were analyzed using simple descriptive statistics (e.g., frequencies,, 
proportions , . rankings, means, and standard deviations). Using appropriate 
tests of statistical significance (the square and median test), the 
independence between and within groups of parents were determined for \ V 
each study year and across study years .. Group differences were analyzed \ 
using analysis of variance. A path analytic model was constructed to note 1 
the effects of parental characteristics on the decisions they made about 
their children's schooling. When significant trends were apparent in parental 
attitudes and behavior over time, Maxwell tests (1963V were used to 

partition these trehds 'into linear-,and nonli near components. 

? ' * ' * - . 

5. Findings 

The findings of the parent /Community Surveys are summarized below 
undef the three topics : parental .information levels about educational t 
alternatives; b. parental schooling decisions ; and- c. parental attitudes 
about educational alternatives*. r - — — t .\ 
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a. Parental Information Levels 

• Information levels were higher among socially advantaged 
families; educational background emerged as an especially 
important factor 

• The variability among parents V information levels decreased 
as parents became more experienced with the choice system. 

» Less educated families put more reliance on information-^ 
»* v . gleaned from personal contacts with more educated parents- The 
more educated parents relied more on printed information. 

• : • - ■ ' , " ■ } 

b. Parental Schooling Decisions 

• Regardless of educational background, mothers were more 
involved in schooling decisions. Less educated fathers 
appeared somewhat more involved with their son s 1 educations 
than their daughter s !. J . 

. • . Geographic location remain e d the most important factor in 
parents 1 placement decisions, even when free transportation 
/ was provided. * • 

• The* more distinct programs were from each other and the older 
the child, the Less important geographic location became 
in parents placement, decisions. 

• On the whole, curriculum factors were less important _ than 
non instructional [factors (SES school composition; maintenance 0 
of sibling and friendship relationships, school, location, etc;) 

• Less educated parents are more likely to emphasize children's 
obedience and respect for authority than more educated families 
who tend to encourage creativity and reliance upon internally 

' ' set standards* - w ' • / '■' : ■' ' z.i.. J. . V : 



. ^iml L-nnnnnnncirsnnnral 



jam l ^» w iliatai i rs ^w +rm 



• When parents have free choices, children from socially 
advantaged families will tend to be over-represented 
in less structured, open classrooms. 

C. Parental Attitudes 

* Parents 1 global evaluations of the schools were generally 

* lower than their evaluations of the classroom teachers 
who came in ^contact with their children. 

■ • The more powerless parents felt, the less satisfied they 

tended to be with the educational system and the performance 
of school personnel. / 
0 In general, parents 1 satisfaction with the schools increased 
at the outset of an innovation and then began' to fall as 
the situation failed to live up to their original expectations. 

• Parents 1 satisfaction tended to decrease when their schooling 
alternatives were limited 'after a period of wider choice. 

6. „ File Descriptions 

There, are six Parent/ Community Survey files, each corresponding to 
an administration of the survey. Since the type of data and kinds of 



respondents have been described earlier, only 


information 


on respondents' 


and number of variables 


is summarized here. 






File/ Adminis tra t ion 


..Respondents 


Variables 


Fall 1972 


1,447 




A28 


, ... ' Spring 1973 


239 




574 


: . Fall 1973 


1,502 




556 


Spring 197 A 


- . 233 




534 


Fall 1974 ' . 


— 8,170* 




A 35 


Fall 1976 


p 84 A 




334 


Total number of records 


(number of cases not 


Sellable) . 
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C. TEACHER SURVEYS 

1. Background and Pupose 
The Teacher Surveys were a part of the overall evaluation of the 

Elementary Education Voucher Demonstration/ The primary purpose 
of the evaluation was to measure changes in the Alum Rock district: 
attributable to the Voucher Demonstration and to determine, specifically, 
the relative impact of various aspects of the Demonstration on educational, 
political, and social developments in the community, . Periodic measurement : 
of voucher and nonvoucher teacher attitudes toward the Demonstration was 
an essential component of this evaluation. Seven Teacher Surveys 
were conducted, the first in fall 1972 and the last in winter 1977- The 
Archive contains information on the first six surveys. 

The purposes of the individual .surveys differed somewhat. For 
instance, the f^rst survey emphasized the expected outcomes of the EEVD 
and the winter* 1$74 survey attempted to discover possible nonresponse 
bias. However, all of the Teacher Surveys shared a common purpose, namely, 
"?^" f : . to elicit teachers' attitudes toward, and. experiences with, the Voucher 
Demonstration in Alum. Rock. 

2. Sample 

The universe of " Alum Hock teachers was targeted for ail but one 
Teacher Survey: The. major reasons for targeting the total population 
; i were 1) the desire to obtain the largest possible response and 2) its 

size "(600 to 700 teachers), which posed no distribution or coding problems 
, f or the evaluators . : 
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The overall response to the seven surveys was relatively 
substantial, with rates ranging from 63.1% to 87%. Follow-up procedures 
were used to improve response rates, and, in .later surveys , the ^ 
questionnaires were distributed and completed during conference time, 
rather than mailed to teachers 1 homes. A study of possible nonresponse 
bias showed no significant differences between respondents and non- 
respondents in the Teacher Surveys. 

All but one survey drew a sample from the universe of Alum Rock teachers. 
Because the Winter 1974 Teacher Suryey was conducted by telephone, it 
was too costly to target the universe, which numbered 636 teachers at that 
time. This survey targeted 25% of Alum Rock teachers (159) and had a 
response rate of 94%. 



3. Data Collection 

Since there were several administrations of the Teacher Survey , information 
on the date, type of survey, and number and length of the questionnaire forms * 
is best related in a tabular fashion. >r 



TABLE 7: Teacher Survey Forms 
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Administration 



Fall 1972 
Spring 1973 



Winter 1974 



Spring 1974 



Spring 1975 



Spring 1976 



T2£e 

self -administered 
mailed 

self -administered 
mailed 



telephone; 
interview . ' 

self -administered 
mailed 

self -administered 
at faculty meetings 

self -administered 
at faculty meetings 



rms 



voucher 
nonvoucher 

voucher 

expansion 

nonvoucher 

#. . 

voucher 
nonvoucher 

voucher 
nonvoucher 

voucher 
nonvoucher 

VQ{xcher' 
.nonvoucher 
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Number of Data 
Items Per Form 

338 



236 



94 
141 
109 
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The changes made in the Teacher Survey instruments for each adminis- 
tration are discussed generally below. In this discussion, only the voucher 
forms are treated. Subsidiary forms , (nonvoucher and expansion forms) were 
always shorter versions of the voucher form since questions about partici- 
pation in the Demonstration were omitted. 

a. Fall 1972 

The fall 1972 instrument was the longest version of the Teacher Survey. 
Its general content areas were 

a teacher background data; . '■ 

o descriptions bf the educational situation in Alum Rock before vouchers; 
' • attitudes and expectations concerning the Demonstration; 

• opinions about educational problem^. 

b. Spring 1973 

The instrument used in the spring 1973 Teacher Survey was a shorter 

version of the f ^ 11 1972 Survey. The following types of questions were deleted: 

. « • ■ 

• questions relevant only at the outset of the Demonstration; 

• seasonal questions; 

• questions about attitudes that were not expected to change- over the 
short run; 



• questions that did not provide useful answers in/the first administration. 

& ' 
The most important difference between the fall 1972 pjxd spring 1973 

version 5. was that the spring version tried to uncover teachers' actual exper- 
iences with the Voucher Demonstration now that it was^underway. A questioy 
in the fall 1972 version concerning expectations was reworded to draw out 
experiential data. - ' 

c. Winter 1974 

The winter 1974 Teacher Survey % was administered by telephone. As a 
-result, this instrument differed dramatically in 'form and in length from the 

93 
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other six instruments-, The instrument was similar to previous instruments only 
insofar as it included an open-ended question about general attitudes toward 
the Demonstration which appeared in every other instrument as a closed-ende d ' 
question. Other open-ended questions posed in this survey concerned changing 
teacher roles, positive and negative features of the Demonstration, and 

changes teachers would recommend to improve the voucher system. 

... * • * 

* • . :'...* 

d. . Spring 1974 ^ ; 

Like the preceding' and subsequent survey instruments , the spring 1974 

? « . • 

Teacher Survey instrument sought to gather information about teachers 1 

characteristics and general attitudes toward the Demonstration. Some new 

• ' z ' ».■■.' •' 

question areas were added: costs and benefits of the Voucher Demonstration / 

to teachers; educational offerings and outcome* oi the Demonstration; and, 

teacher control over ixLnischools, including the use of the income/outgo 

budgets. Despite these new topical areas, this instrument was the shortest 

of the self -administered Teacher Survey questionnaires. "«\ 

e. Spring 1975 •* 
The instrument used in the spring 1975 Teacher survey was longer, 

due to the inclusion of a 36-item work environment scale (WES). Questions 

about -background and general attitudes toward the Demonstration were 

>. " * ' ^ - \ ..... ' 

retained . Questions about community /school relations ve.re added to ' 
parent/school section, and. a new "topic, educational diversity, was in- 
corporated. This latter addition reflects a shift in emphasis in the 
Demonstration. The original voucher concept sought to increase parent 
choice through minis.chools ; now educational alternatives were being created 
at the 'school level. Other new questions in. this instrument concerneJ 
the organization of schools and minischools; perceptions of change in 
Alum Rock; decentralization and .decisionmaking; and'economic incentives and 
expenditure decisions. 
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f . Spring 1976 

In Spring 1976, the instrument used varied only slightly from the 
Spring 1975 version. 

A. Study Design ". 

The Teacher Survey was ; longitudinally designed, with the first 
survey (fall 1972) forming a baseline against which, teachers' attitudes, - 
expectations, and experiences in the subsequent implementation years ctfuld 
be compared. However, over the years of implementation, the Voucher 
Demonstration deviated increasingly from the original transition model. 
This was most dramatically evidenced in the minischoql's loss of autonomy and 
power which tended to remove teachers' incentives to maintain new mini- 
school programs. 

As a result, naw issues and problems arose (e.g., interest in th$ 
school as a dork environment) which necessitated changes in the Teacher 
Survey instrument. While a core of items remained in all of the Teacher * 



Survey instruments, much of. the data lacked comparability from survey to 

' . ■ » ■ r ■ ■■ / 

survey. To some extent, this limits the usefulness' of the original 

longitudinal design. - ' 

5? Data Analysis 1 - 1 

. v ■ " • : 

A variety ofxtechniques were used to analyze Teacher Survey data. N 
Items were* intercorr^lkted to determine whether they were actually measuring 
the same thing. * Percentages and crosstabulations were used to show the 
degree of favorable teacher response to questions about the .Demonstration " 

and teachers 1 assessment of specific factors of the Demonstration . (e.g. , 

— ■ N N ■ , ■ 

class size, discipline, and instructional equipment). Significance tests 

• • . * » "* * 

were performed to comparer-voucher and ^nonvoucher school teachers 1 background 

characteristics and generai;predisposition to the Voucher Demonstration. * 
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Eight indices were constructed from the survey data using a variety of 
techniques: simple summation, correlation, and factor, analyses. ( Regression 
analyses, were' used to develop general parameters of teache'r response and 
to, determine the best predictors for teachers 1 overall support of the . 
Voucher Demonstration. 

6. Findings ; ' < . 

Many teachers liked the Demonstration primarily because it meant 
extra money, choices for parents, ^and more influence for teachers. - However, * 
i as the, Demonstration progressed, teachers 1 loss of influence over curriculum, 
budget, and staffing decisions contributed to the demise of minischoqls. 

Most voucher teachers initially thought the quality of education in' 
Alum Rock would be .improved, but , by the fourth year, less than half thought 

that it actually' had 'improved . The average nonvoucher teacher thought the 
Demonstration would Tiot affect the quality of education In Alum Rock one 
way or another. 

Throughout the Voucher Demonstration, a large minority of teachers 

* •"■ '.."*■ 

felt that parents lacked the necessary information to make the best 
program choices for their children. In 1977, after a major reorganization 
of programs, only 16 'percent of the teachers in Alum Rock felt confident 
that parents had enough information to make good choices. g * / 

Teachers in the original six voucher schools were mora enthusiastic 

than the expansion school teachers about the alternatives -the Demon- 

• • ■ . tf " * * 

stration afforded. Of the three teacher groups, nonvoucher teachers 
were least enthusiastic about the Demons tratitJH. Corisistent with their 
' level of support for the Demonstration, ^voucher teachers were most likely , 



to favor parent choice. The best, predictor of support for. p 9 vent choice 
w^s the teachers 1 assessment of the Demonstration's effects oh students. 
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"7. File Descriptions ^ * 

Since descriptions of the purposes and forms' of the Teacher * Survey 
i have been presented earlier \in this section, the description of the files 
'here is limited to a listing of the number of -respondents and the number 



of variables in each administration. 



File/Administration 


* Respondents 


Variables* 




Fall 1972 •'. 


409 • 


•'+".. 
' 345^ 


< 


, . Spring; 1973 . ' *(p. 


417 


2,82 




Winter 1974 • 


N 151 


14 




Spring 1974 .. 




, . ° A 95 




• 

Spring 1975 • 


534. 


f45 V 




. Spring 1976 *. 


505 


*• .,113 





* This number pertains to the variables in the voucher version. 
+287 of these variables related, to nonvoucher teachers. » 
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D. Student Metropolitan Achievement Test 



1 . Background and Purpose . ^ , " ■ 

Neither the thepretical model of education vouchers, nor the modif i'ed - 
system of alternatives, implemented in Alum. Rock included explicit plans 
for Improving the educational performance of students involved ^in the 
Demonstration. StudeiJt performance was never considered a so.le criterion 
of tie Demonstration's ^sufccess. Regardless of whether particular per- 
formance standards were achieved, if parents were more satisfied with the ' 

• • • . . • ' ' ' ■!«•"*• 

educstioh their children received, the. Demonstration would have succeeded 

a' ■ ' • ■•'.'!'• 

"in. meeting one of its stated' objectives .v However, the Demonstration could' ' 

not be consid'ered completely "successful if the performance of- participating 

■ . ."* • *,..*.' • ' ' ' * ' • ' ' 

students declined. For, -this reason, it was necessary to evaluate whether ' 

or not students did as well -as might' be expected if no 'innovations nad 

«•'•.•■• . . 1 . ' ■ . . % \; 

been introduced* * ■■• * 
. . % „ * . * • „ - 

- The u^p©f student out^oijie^ measures v has been, and continues to be, the ' 

subject of muf6K controversy' amonfe educational researchers. A p \r t i cu lar ly 

important issue in this debate -is the extent to 'which outcome measures V 

should be tailored'to specif it 'program objective** (Ebel, 1978; Popham, 1978). 

.35 *• *■ . * * 
Standardized achievement tests provide ^a common ' "yardstick" for .comparing 

. > . . /V N % • . - 

one. program w^th another; they are relatively easy to use since they are " 

accompanied by simple guidelines for making comparative, norm-referenced 

interpretations.. Opponents of standardized tests argue that ttjese benefits 

\'\ . - . ; . • . -. v - . ^: : . / ■■■■■■ 

are obtained at the cost of relevance and specificity ancl that meaningful*-'' 

\ . •. " .. . . : * •■ V ^ V"'# .• ; . \ •■ K ' ' "' 

.assessments of program* impacts should employ measures which permit "objective 

'.. . • . • • . ^ ' . ...... • r ' . 'v . " -. • a. ' :■ - ■ ; 

based" comparisons.' Such criterion-referenced test!* are designed specifically 
to ^determine whether &g particular program or treatment is achieving its^stated 



goals. .These tests do not employ a neutral or conuuonly-agreed-upon goal. 
* as do norm-referenced -measures. v 

, Vhie Denlonstration evaluation staff was well aware of the issues associated 

» . . . *. « . ■ n _ ■ * 

. » i - . & * • . * . : * * 

with, using stand^rdfz'ed- achievement data for measuring academic student 
outcomes. , The staff chose to.yse these. tests because they would generate 

' ' o ' ' . • • • ': ■ • v 

the best available data. . 

In analyzing' studfent standardized achievement, the evaluation attempted . 
to answer two questions, ' ; ■ . , r 

• ■ * ' • , ... ;•''.•■■'.% *?. .' • 

•„ To what extent has thei Alum Rock Demonstration modified the per-* 

formance of participating, students? ' \* • • • . 

— sT- — ' ' • •' V • . •• 'T • . 

.. What measured features of the Demonstration can be shown to account 
fpr ^variations, in .Alum Rock student outcomes? i \ 

2. Sample • V ' - 

Two samples fox this substudy 'consisted of fojur grade-level cohorts 

- * * / ; , ' .-. " ■ 0 \ 

(3rd through 6th grades) which, had usable test data and were in* the elementary.' 
grades throughout the .thitd, fourth, and fifth years of the Demonstration. 
The cohort sample sizes varied from analysis to analysis*. Roughly 60% of 

. * ' v ' * - \ '* * ••• ) V.\'.-. 

these cohorts were Spanish suraamed and the same percentage were eligible \* 
for free, lunch. More than 60% of each sample were "voucher students . " The \ • 

V ' ... • ^ . . N _ 

"grade six cohort contained a ^omewhat higher percentage of voucher students, \ 
since, by the sixth grade many nonvoucher stud'entf's had begun to move toVmiddle 
scl^ols, which "were predominately voucher schools. t s -7 

^ . . - • . • 

3. Study Design 

Total reading* scores from the Metropolitan Achievement Test (MAT) were • 
the achievement data ; useds as dependent meiasures in the ""analysis. Background 
measures of ethnicity i language spoken a t home* and socioeconomic status 

100 
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were used as covariates^Ln thfe analysis; specific variables utilized were 
limited to *thos^ available on the longitudinal student file in the. Demographic 
Data, Base. Dummy variables were used to indicate whether a* student was / 
Spanish surnamed and whether Spanish 'was spoken^ in the student's home. 
Eligibility for. the federally-funded free lunch program was used to approxi- 
%iate SES, since eligibility for the program* is determined by family size 

*■ .•?•■■■ ' f 

1 an4 income. Absence fifom school was also usied as- a icovariate in the analysis, 
? as a possible intermediate level program effect and consequent cause of • 
achievement differences. « . . ; 

• • The Student MAT substudy was' designed as a quasi-experimental comparison 

of voucher students 1 scores on the MAT with those of a "control group" not 

* » • ■ 

"exposed to the "treatment." The control group was composed of Alum Rock 

elementary students who did not participate in the Demonstration: 

To telated certain features of the Demonstration to student performance, *' 

information was drawn from teacher surveys administered in the third and 

fourth years of the Demonstration (1974^75, 1975-76) . Some of the variables 

drawn from thesfe surveys were teacher attitudes toward the Demonstration as \^ 

a whole and their -perceptions of the. school environment and changing rates ^undei 

the Demonstration. To explain student achievement <on the MAT,- other information 

was considered, in the' analysis. This other information included student pro- ' 

: gram enrollment-, place, of., residence, «and perceptions of the school environ- / 

ment ,~ as well as indicators of school arid program characteristics. ^ f 



A. Statistical Analysis ^ v; . : » 

Analysis of covariance was used ' tp # assess the effect of the variable * 

0;;,. •■•^•-•^ "/■■;- r " : ->'..: ! ; >-. : / ; . v-'.y . . . -V> " '•' 

■■"school -type" (i.e. , voucher or .nonvoucher) » on teadlng achievement. 'Control 

variables used to adjust f or jciontreatment or nonpar ticipat ion related to 

■ • . . - - - - ■■ ; -.. . — j 1 ' 



preexisting differences among students ethnicity (Spanish surnamed or 
other); Spanish spoken at home, eligibility for. free.lunch, and number af 
days absent during the period of the analysis. * ^ , '>'[ '■ .'" ,. «•* 

Anaiys.es were pertormed^ on four cohorts of .students — thitd, fourth, 
fifth,, and sixth grades as of spring 1976 — arid three time, spans— fa\l 1974 
( to spring 19.75, /all 1974 "to spring 1975, and fall 1974 to fall 1976). The 
MAT administered in fall. 1974 served as the pretest. . 

5: Findings .) 

The major findings of this ^suBstudy- was that students who participated 

^ ■ - ■■• " ■ - 

.in ,the Demonstration performed less well on standardize^ achievement measures 

than students wfro were not directly involved in the Demonstration. ' The* . 



reasons for this difference appear to *be unrelated- to the existence of ths^ 



Demonstration, and to have, been largely unaffected by the Demonstration • 
* Regarding features. of the Demonstration likely to affect student MAT 
scores, only rainischool size seemed' related. However, this effect was. ^ 

positive during the' third year of Q » '.re Demonstration and negative during the 

* ■ • . . • 

.fourth year. .Moreover, students who -changed rainischool programs did not 
achieve more educationally. •■ ° . 

The attitudes and perceptions of teachers and students toward the 
^Demonstration also appeared* to be -unrelated to reading achievement .in voucher 
. and nbnvoucher schools. ^ « 
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6. File Description « 

>The Student MAT- data is housed in one file which covers fiv^years of 
.*■'.* * ^ . ■ » -• ■ 

the Dempnstration. This file contains 25,878 cases and 730 data items * 
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E. CHILDREN'S SELF-SOCIAL CONSTRUCT TEST (CSSCT-)' '* , . 

• ••• *.* . 

1, ' ^Background 3ftd Purpose ..'•/■■ • 

The e valuators . of the Elementary Education Voucher Demonstration "... 
conducted a study to explore .a richer of student outcomes. Among' 
these&outcomes were both cognitive and noncognitive effects. Specifically, 
cognitive .effects were measured using the r-.\ading component of the 
Metropolitan .Achievement- Test {MAT), which was administered several 
times during the Demonstration. Examples of the ^oncognitive effects - 
the eyaluators sought to measure were teachers 1 perceptions of theii* 
schools and attitu^fe^ toward the Demonstration, perceptions of change 
in Alum Rock schopl-cbtamuhity relations, -student perceptions of the 

Demonstration, a;id a variety of psychosocial effects of ^thd> Demonstration 

' f •• * * • # . 

on students* .V* % 

* ■ ' ■ • ■ * * '• 

The Children's Self-Social Cojvstruet Test (CSSCT) .wa^ one attempt 

to measure certain noncognitiye student outcomes. .Based on work by 

. v .p . " • * ^ 

Ziller (1973), this nonverbal instrument measured the. dimiensions of 

self-esteem, social. distance from significant others in the school .en- 

vironment, scope of peer attachment, and perceived individuatibti. The 

, nonco^'.^ive, psychosocial constructs measured were important to the 

■ • 4 

Demonstration both as outcomes in themselves .and as meBiating effect's on 

■ ( ' ' 

school achievemSht . : ' > , 

■ ■ * - 

2. Sample . " ■ ■ ■ ! v. ^ 

The sample used in]' the CSSCT substudy was^drawri .from' „the, ^longitudinal 



-it- . 



Stud^at MAT data file which contained data oiW7,1A9 students in 1975 and 
2,252 students in 1976.^ Approximately 65% of these students in Kindergarten 



through eighth L grade were in voucher schools.** 




I 



V ■ . 98 

/ 



v, 



\ 3. Study Design 

< The basic pre- post-test Resign was used. ... However, since the data 

used .were gathered in the Spring of the third and fourth years of the 

* *' * ' 

Demonstration, the examinatior^of effects was limited to those occurring 
in this interval. Grade, levels were* combined in the analysis, since * 
the instrument was appropriate for multiple grades. In addition,' to 

investigating overall voucher /nonvoucher student differences on "the N x 

' • . . . ■ . . ** . . * , • • '*■'••*'... 

• ■ , v : . ' J. \ * ..." • - • * ... 

CSSCT, the study explored school type (i.e., voucher/nonvoucher) by 

: / ■•" . . . ' - • • ' ' . \ '• -\ t ' - ■ * ' 

t^ade levsl interactions. 

Similar items on the CSSCT were averaged to form four measures des- 
cribed below. These measures were used in the CSSCT substudy both as 
. independent variables in analyses of achievement outcomes and as out- 
comes in ^themselves, i 

* a ' Two types of items measured social distance from significant 

others in the school environment, (i.e. , from both 'teachers aijd 
peers) and lack of social interest s . The last in a row qf^circles-, 
» Was marked to represent the target figure (teacher-dr'^peer) . The 

student, was asked to represent himself bv marking one of the other 
circles. "Social distance" was the distance. between the student's 
circle and the target figure 1 s^joircle. Items measuring lack of 
social interest presente'd a^set of three^ circles representing par-' 
ents, teachers, and^fxiends and formed a social influence triangle. - 
The student was^asked to represent himself by drawing a circle any- 
M where on the^page^ These items were scored according t to whether the 

student^s^circle fell within or outside the triangle. J 

* " V * ' 

o To mWsiire self-esteem >students were told to choose a self-repre-^ 

jsentlrxg circle f rom^^vertical. or horizontal rcw of circles. • 
* * ^Choosing* a circle vfiigh on the vertical row or near the left §nd of 
the horizontal row indicated high self-esteem. \ . t * 

(V A determination' of the scope of peer attachments was formed using 
^* items which directed the student to draw any number* of lines^be— 
: 'tween circles representing other students and himself. /^*~~ 

• Perceived individuation was measured by asking the student to choosy 
a self-representative circle from a collection of circles, a few of 
which differed from the majority of circles. * . >* 
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4* Statistical Analysis ' 

1 ^Vv:' : .: / , . . . . : . ■ 

" Analysis of cibvariance was used to investigate the 'CSSCT data. 

The covariates used were free lunch eligibility, Spanish surname, school 

•type, -and the releyant premeasiireV Due to a lack of variance on the 

\- ' : •"'••'•..■•|- ■ ' • 

fourth scale of ,thA CSSCT ..(perceived individuation) this scale". was dropped 
frtom the analyses. \ .' » • ' . 

5. - Findings . , 

The CSSCT riesults "showed that voucher and nonvoucher student scores 

' .. . • ■■ '.. \ • ■ • . ■ ■ ■ /" . ■ . ■ 

became increasingly similar to each other from the third to the fourth 
years of the substudy. An increase in social distance was noted between 
voucher arid nonvoucher students. Voucher students indicated that they 
feit closer to their teachers and peers and more a part of the domain of 
social influence. As compared to nonvoucher students, voucher students 
had somewhat lower self esteem^anB^a^Qmewhat narrower scope of peer 
attachments •• • ■■ "j 



6 . File Descriptic „ V" 

The, CSSCT file contains 46 data items for 7,149 students in 1975 and 
2,252 students in 1976. 1 . . 
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PROGRAMMER' S- GUIDE 

This Guide provides a programmer with descriptions of linkage^ variables 
to assist in the merging of various existing archive files to .produce^ 
new analysis files. First, it describes archive. filie categories: student, 

teacher, parent/community, and minischooi. Then, it explains how the 

\ '* " ' \ .. . J * 

data in each of- these categories are related or linked and how these 

\ * ' ' ' . . * ; ' ' ^ " ' - 

data may* be merged. 



A. ARCHIVE FILE CATEGORIES ~ : ~ ~' 

All archive files fall' in one of the following categories. These categories 

represent units of observation for the; particular file:. ' , 

m student (demographic and test data files); ■ ; 

J^.* teacher (demographic and survey files); 9 

m parent /community (survey files) ;, , • 

.'' .9 minisdhool (various program *3ata) * ' " — : — . 

? ■ • * 

1. Student Files 

There are 3? types^ of student files; they are structured as follows. 

• Individual survey and test files' 

. - identification data (STUDENT-ID, FAMILY ROOT) 
. -«selecte<d demographic and location data 
*: . ; - survey and test data ' 

. * ... "\ ~ rt- 

• Metropolitan Achievement Teat (MAT) longitudinal file f * 

- identification data (STUDENT-ID, FAMILY- ROOT). 

.[ - selected demographic, location, and voucher data 

- MAT scores * ' . _ 



• • Master longitudinal file '." 

• identif icatioi^data (STUDENT-ID, FAMILY ROOT) , c- V 
demographic data. » <i , C • 

- location and attendance data ; " \ 

• > voucher application data 

• — ^transfer data 

• ' . • teacher data (TEACHER-ID ) ;;V * 

• ■ ' ■ , - 1 **••■• 

- catchm6nt data* »;. y 

-jt -federal pFoj^ao data (AFDC, free and reduced meal eligibility) / 
' - compensatory voucher data 
In the student files 9a all records (or cases) arei associated with, and 
describe,' students. Each case is identified by "a unique identifier called 
, STUDEN^-ID DMC-ID . S^ODENT-ID is nine-digit number derived from the 
following information: \\ m y 

• FAMILY ROOT: digits. 1-6; 

SIBLING SEQUENTIAL NUMBER: digits 7-8; 
• . ^ • modulus 11 check digit: digit 9 . : 

■ ; . ■' c ■ & . : ■ " •„ •••• • ■ ■> ♦ . . 

"hen the files were first, created, each student was assigned a FAMILY 
ROOT. All siblings in a family werei designated by the same FAMILY ROOT, 
and differentiated from one another by a- SIBLING SEQUENTIAL NUMBER. ".. ' 

As new cases (students) were incorporated Muring the file maintenance 
process, it was necessary to determine whether a voucher ' student had 
siblings who were also participating in the Demonstration. If so, the ' 
"new" student's ID consisted of the FAMILY ROOT of his/her siblings and 

. the next SIBLING SEQUENTIAL NUMBER. If not, a new FAMILY ROOT was created 1 

'■^£/ : -' \>>, : -yi t:Ko y y :-r-/' : .;. ' V^'/Vy^Y-l: 'If..; :/:r : >: 

]$and the student was assigned .the SIBLING SEQUENTIAL NUMBER '01. For 

^- .subsequent Demonst rat ion years 2 , 3, M,*5, the initial SIBLING SEQUENTIAL 

NUMBERS assigned were 11, 21, 31, 41, respectively. , , 



Then, a standard modulus , 1 1 check digit was^generated. /Since all 
Demonstration students from one family share a, FAMILY ROOT, a one-way 
frequency. analysis on FAMILY ROOT could be used to determine the total 
number of families, the number' of participating siblings in a given family, 
the average number of participating students per family, and family "size " 
distribution..- .\* : . '•' '•'/•' •' >• ' •' ..'•„' 

" In summary, 'each family is identified by a FAMILY ROOT and each student 

■ ■ *.'■-- • • . ■ " • > ' 

within each family Is identified by ^--different- SIBLING -^EQUENTIALr-NuMBER-. 
Combined with modulus 11 check digit, this method results in a unique nine- 
digit STUDENT- ID for each participating student. 

. . ... •*•. . ' •'• v.-* . ■• . \ " : [ ; ., . 

2. Teacher Files - r V 

The two groups of teacher^ files are structured in the following manner. 

.* ■*■ •* •. 

- v • Individual survey files # ° 

*~ " : 

- identification dat£ (TEACHER-ID) 
--.survey data x 

<v 

• .Master longitudinal file 

* •• . * ■•.•*.. 

- identification data C'fEACPER-iD) 

p <jr*- uemographic data $ 

-.employment data N 

* " • ... w 

• - assignment data . ;" ■ 

^ j <=»» 

• - transfer data - • • 

• - absence data . . " > 

■ ■ ■ --" . • . • . * . 

In these files, each case unit of observation represents one teacher 
uniquely identified by a six-digit TEACHER-ID (DMC-T-ID). The * >'•' 
identification number was created as follows: ° % - .' -J*"." 

• unique five-digit number: digit '1-5; V 

• modulus 11 check di&t: digit 6. 
' 48 new ^achera (cases) wer;.e Identified during file maintenance, they 

were assigned next available sequential i TEACHER-ID . : '^>^-< : ' 



3. Parent/Community Files 



Each parent/community. survey file contains 

• identification .data (FAMILY ROOT); ^ 

,* • • *i • ■ — ' 

• selected background data, * 

• survey data. # ; 

Each parent, that is, mother (or father,,* if mother was not available), 



. is one case unit of -observation, identified by a unique six-digit 

FAMILY- ROOT. Parents whose child(ren) participated in the Demonstration 
; have * tlie same FAMILY ROOT as their child (ren) . . V 

!».' Minischool FileT % 

Minischool file cases, are organized into these sections: 

• identification data:.<MINISCHOdL-ID) , . . ~ 

; ■ ; •. ..." .' ; ;»": • • 

^ • school data, . \\- * 

• minischool staff data (TEACHER-ID), 

• mihischooi. facilities data, 

c enrollment ^ata, * ; 

• classroom data, . ' 

•* budget data, - 

/> . * • . ., ' ■ * 

; • voucher dollar data, * 

• comments data. T 

. • The unit of observation, or case, in this file is one minischool 
• program. Each case is uniquely identified by, MINISCHOOL-ID or voucher 
• program number. : . ,/ • 



B. 'FILE LINKAGE . v ^ . \ < 

1. General * . • / * . . V ' 
In order to use specific Identifiers to xaatch cases from different^ - ; 

archive fi^es, it is necessary to understand several general characteristics 
* j of identifiers. ' - b 

ar~ Once an identifier had been assigned, it remaiiiecr unchanged from 
year to year. 

#'■"•'" • * * 
/b. To merge data from different files meaningfully, data extracted 

must pertain to the same time' frame within the five-year Demonstration. 

That is, if one combines data from the files of a 1975 survey, s/he must 

select 1975 data from- longitudinal files. . - 

c. To merge, data from different files for a portion of a year 
only, additional toatchingj is necessary. 

d. . One or more TEACHER-IDs may appear in each case in the student 
longitudinal file. There are two reasoris for this: 1) the student ■ 

/ transferred from one school or minischool to another school or miniachool; 
2) teachers were re-assigned classrooms. To indicate when a student was 
in a teacher's classroom, a starting date was assigned to each TEACHER-ID 
in the student longitudinal file. Consequently, when merging student 
, and teacher files for a given period within a school year, a TEACHER-ID 
corresponding to the student's teacher at that time must be selected. 

2. Linking Data 

The data desired for secondary analysis may reside on different 
archive tapes and, furthermore, may be stored in more than one of the 
^ categories described above . Therefore , the first step in creating a 



new -analysis file is determining which identifiers must be used to ' ' " 

* » . ' \ >. • • . ' . ■ / m ' ' 
match and link corresponding cases. 

In this section, we describe all possible linkage combination's for 

■ > • . \^ ' ' j * ' ■ * ' " 

Any two, file categories. .If three or more files are to be linked, two - 

• a ®t A • . • ■ ■•' • . 

files are linked^fir^st to create -a 'simple merged file; then the third 

\ * ■ ■ ^ : • • \ ' ' 

file is linked to the, merged file using the same procedure. 

. * ■ \ - . * " ■ 

\ ' c ' . • • ' . . " - ' 

a. . Student-Tarent LinkV ~- 

Objective: link student transfer activity and parents V . 
« feelings and attitudes about voucher programs* 

Variables .describing student transfer data will be extracted from 

the student* master longitudinal file; variables describing, parents' v 

% feelings and' attitudes will be extracted from the parent/community survey 

file. Cases will be linked by matching FAMILY ROOT (first 6 digits of 

STUDENT-ED) of student cases and FAMILY-ID of parent survey cases. 

b. Student-Teach&* Link 

Objective: link student attendance and ^teacher experienced 
, . The "toaster longitudinal student file provides attendance data . 

and the employment section of the master longitudinal teacher file 

i • - ..*.'" ■* 

provides teacher experience data. Cases from, both files will be linked 

t • • . .. , ■ '• . .'■ • '■■ i ;'. 

* using * TEACHER-ID from the teacher file and matching these TEACHER-IDs with 

with those in the teacher data section of the student file. \ 

■ „, ^ ■ *■ ■' 

c. Student-Minischool Link 

Objective: link student MAT scores and minischool classroom 
": .* . . : data v 

Student location data (school, rdnischool, and classroom) in the 

MAT longitudinal file will- be matched with MINISCHOOL-ID in minischool 



data and MAT score variables (from MAT file)., Classroom data (from 
minischool fi^e) will be extracted for matching cases. 



\ 



d. Parent-Teacher Link 1 " 

m * » • 

j ' ' '• • ■ / t • 

Objective: link parent' 9 and teacher's survey responses 
.on minischool programs. 

The files will. -be linked by matching minischool data (TEACtffeR-ID) 

from the parent file and TEACHEB-3D from the teacher file. Selected. 

variables then will be selected from each matching case. 

.:V' . . : i 7 • V ' .. : 

e. Parent-Minlschool Link 

f , . / * . . 

Objective: \J.lnk parent's educational background and minischool 
. "■■> *V "budget data. ; 

Cases will be matched using the miiiischool data (MINISCHOOL-ID) 
in the parent file and the MINISCHOOL-ID in the minischool file. Selected 
demographic data on parents and minischool , budget will then be extracted 
from both files. 

f. Teacher-Minischool Link ~ • 

Objective: link teacher absence data and minischool voucher 
v dolldr data. / fj 

Variables describing teacher absence data will be extracted frosr 

the teacher master file; variables describing voucher dollar data will 

be extracted from the minischool file. Cases will be' matched on TEACHER-ID 

„ • ■ 

■ ■ '<■ ■ i ■ '. ~ * 

from the teacher file and TEACHER-ID from the minischool staff data of. * 
the* minischool file/ ^ ±. * 

C. FILE MERGING • ....''.*.. 

Creating a work analysis file usually involves several steps. The 
example below illustrates the procedure, used to merge student MAT v 
scores and teacher experience in the second year of voucher demonstration. 



Two utility programs are used in this example: SELECT and TAGUP 
(NORC, University of Chicago). \' 

Step»l; Select Appropriate Files, 6 » - 

i * # * ■ « *. * 

In our. §xample, the appropriate files are the Student MAT j,k 

.■•'•* ■ . f * • 

longitudinal file and the longitudinal £eacher master fkl6. • • . 

• ' • . . . * ' " \ > 

Step 2: Create Reduced "Answer 11 File 

The MAT file containing TEACHER-ID and MAT scores is used to . . + 
create the reduced answer file. -First, use the%£T codebook to identify 4< 
the appropriate variables and their locations. In our. example, TEfcCHER- 
IDs were in locations 21-26 and year two MAT scores ^ere in' locations 
K)1-150 (10 variables in qcmsecutive locations, each one occupying five- 
character fields). The SELECT utility program contrail statements are 

100. EQ «2» • 

.V M 21-26 To 1-6 • 

M 101-150 To 7-56 • 

This statement will select the MAT scores of only those students 

..•„■•«■ 

present and was tested in Year Two. The resultant output record will 

be 56 characters in length, 'since TEACHER-ID was moved into locations 

* .." '« ..*■.'■■•' * 

1-6 and MAT scores were moved to locations 7-56. r — 

Step 3: Sort V'.. * 

Sort created answer file on TEACHER-ID, that is, on major sort key 
in locations 1-6. 

Step 4; Create a Second Reduced Answer* File I 

The second reduced "answer" file will be generated using the teacher 
master file containing TEACHER-ID in locations 1-6 and variables in locations 
7-30. The retrieval program SELECT described in Step 2 will be used. 
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•' " * . ■ \ 

Step 5:* Sort Tea cher* An swer File ■ . 

The teacher answer f4.1e#£^ sorted by TEACHER- ID, using the procedures applied 
to the MAT answer filefend described in Step 3. * ♦ 

V Step 6P^M^ge t the Two Answers Files '• • ■ , ^- , 



k 



\ '. [ ,r i • ' . . • 0 - . • 

Now there are two answer files,* each having a different number of cases. 
Since the MAT answer file describing each student 1 s MAT scores has TEACHER- 
H? as an identifier, all students from one classroom have the same 

.: *" ' ■ ' . 

.TAGUP is a suitable utility program for elating the new combined 
analysis file.- TAGOP is capable, of merging, " or "tagging up." data from 

• ' • \ "... ■ x - • . 

"group" records to corresponding- setjs trf ^Individual* records, * In our 
example/ a group is< a teacher and an individual is a student . * 

\ . ' " .' • - 

The inputs to TAGOP will be. the 'MAT answer file r described to TAGUP 

as INDIVIN; and the teacher answer-file, described to TAGUP as GROtfPlN. 

The output will be an MAT answer file with teacher data "tagged" to it 

and described to TAGUP" a3 INDIVOUT. The TAGOP control elements will 

"then be: , * • . 

; GROUP = 1, INDIV = 1, LEN = H . 
; . TAG 24 ^ 7 57. 

'.'..*■■•■ , i ' ■ •' 

The first statement describes the starting positions of matching 

■ \. ■ ■ '•• ... . ■-■ ' / 

sequence numbers (TEACHER -ID) and their length ( 4 digits). The second 
statement will "tag" teacher data 24 characters in. length (in locations 
7-30) to each matching ^student record (locations 57-80); " 

The final INDIVOUT analysis file will have the following layout columns: 
1-6 Teacher-ID 

7-56 Student MAT scores .A 
57-80 Teacher data describing- teach6r f s experience/ 



Temporary answer files can now be discarded since the new merged file 
N t vlll *be used f as input to analysis programs./ ■ ■ ■ - ~ ^ 




